-- Logs begin at Wed 2022-09-07 07:14:15 UTC, end at Wed 2022-09-07 08:41:22 UTC. -- Sep 07 07:46:45.993038 dv-cinder-836027-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 07:46:46.001161 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 07:46:45 2022] *** Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: nodename: dv-cinder-836027-10-iscsi Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: machine: x86_64 Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: clock source: unix Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: pcre jit disabled Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: detected number of CPU cores: 4 Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: current working directory: / Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: detected binary path: /usr/bin/uwsgi-core Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: your processes number limit is 47680 Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: your memory page size is 4096 bytes Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: detected max file descriptor number: 2048 Sep 07 07:46:46.003229 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: lock engine: pthread robust mutexes Sep 07 07:46:46.004006 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: thunder lock: enabled Sep 07 07:46:46.004006 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 07:46:46.004006 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 07:46:46.042485 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: Python main interpreter initialized at 0x563db4b9f9c0 Sep 07 07:46:46.042485 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: python threads support enabled Sep 07 07:46:46.042485 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: your server socket listen backlog is limited to 100 connections Sep 07 07:46:46.042485 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: your mercy for graceful operations on workers is 90 seconds Sep 07 07:46:46.042802 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 07:46:46.042876 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: *** Operational MODE: preforking *** Sep 07 07:46:46.043136 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: *** uWSGI is running in multiple interpreter mode *** Sep 07 07:46:46.043136 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: spawned uWSGI master process (pid: 105493) Sep 07 07:46:46.043318 dv-cinder-836027-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 07:46:46.043868 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: spawned uWSGI worker 1 (pid: 105494, cores: 1) Sep 07 07:46:46.044227 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: spawned uWSGI worker 2 (pid: 105495, cores: 1) Sep 07 07:46:46.045852 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 07:46:46.706993 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 07:46:46.707550 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 07:46:47.797261 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:46:47.797261 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: from cryptography.utils import int_from_bytes Sep 07 07:46:47.797808 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:46:47.797808 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: from cryptography.utils import int_from_bytes Sep 07 07:46:47.799451 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:46:47.799451 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: from cryptography.utils import int_from_bytes Sep 07 07:46:47.799873 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:46:47.799873 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: from cryptography.utils import int_from_bytes Sep 07 07:46:50.314069 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 07:46:50.314621 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 07:46:50.314831 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 07:46:50.315188 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 07:46:50.315442 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 07:46:50.315826 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.316187 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.316414 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 07:46:50.316764 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.316845 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 07:46:50.316928 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.317395 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.317497 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 07:46:50.317703 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.317787 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 07:46:50.318023 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.318137 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 07:46:50.318338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.318422 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.319287 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.319384 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.319643 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.319734 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.319994 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.320127 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.320346 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-10-iscsi {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.320468 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.320671 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.320781 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.320978 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.321104 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.321289 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.321425 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.321608 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.321755 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.321900 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.322032 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.322217 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.322349 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.322521 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.322660 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-10-iscsi {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.322941 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.323081 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.323248 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.323449 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.323568 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.323762 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.323879 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.324072 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.324200 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.324430 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.324558 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.324744 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.324876 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.325054 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.325280 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.325420 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.325592 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.325727 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.325901 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.326031 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.326212 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.326336 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.326548 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.326682 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-10-iscsi {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.326863 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.326981 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.327173 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.327303 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.327494 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.327628 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.327807 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.327947 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.328167 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.328300 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.328465 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.328605 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.328872 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-10-iscsi {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.328997 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.329189 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.329322 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.329502 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.329626 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.329816 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.329951 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.330134 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.330257 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.330455 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.330589 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.330773 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.330910 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.331075 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.331198 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.331382 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.331505 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.331692 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.331824 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.332008 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.332154 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.332339 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.332471 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.332646 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.332772 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.332906 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.333096 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.333227 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.333360 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.333508 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.333700 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.333831 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.333951 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.334117 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.334288 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.334439 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.334588 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.334711 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.334899 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.335022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.335154 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.335275 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.335448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.335571 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.335775 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.335906 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.336119 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.336247 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.336449 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.336576 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.336704 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.336844 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.336966 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.337092 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.337247 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.337370 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.337569 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.337710 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.337885 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.338010 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.338210 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.338401 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.338538 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.338697 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.338817 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.338935 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.339099 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.339221 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.339428 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.339557 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.339702 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.339824 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.340009 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.340150 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.340369 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.340495 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.340689 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.340822 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.341012 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.341135 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.341322 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.341452 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.341642 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.341772 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.341950 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.342074 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.342256 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.342391 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.342564 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.342695 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.342884 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.343020 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.343223 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.343348 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.343504 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.343628 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.343748 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.343875 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.344043 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.344226 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.344372 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.344496 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.344691 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.344827 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.344998 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.345122 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.345305 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.345430 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.345613 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.345752 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.345914 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.346046 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.346200 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.346330 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.346503 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.346628 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.346807 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.346929 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.347112 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.347235 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.347417 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.347541 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.347720 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.347842 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.348025 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.348179 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.348354 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.348559 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.348682 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.348807 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.348951 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.349072 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.349257 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.349387 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.349565 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.349687 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.349899 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.350077 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.350211 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.350332 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.350490 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.350625 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.350798 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.350933 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.351105 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.351237 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.351412 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.351535 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.351733 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.351856 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.352054 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.352221 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.352388 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.352524 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.352740 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.352874 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.353052 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.353200 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.353396 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.353520 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.353640 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.353770 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.353964 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.354094 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.354264 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.354386 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.354571 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.354703 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.354879 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.354994 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.355184 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.355307 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.355490 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.355623 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.355795 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.355920 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.356118 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.356244 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.356426 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.356562 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.356732 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.356857 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.357035 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.357172 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.357337 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.357469 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.357636 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.357760 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.357949 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.358082 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.358256 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.358379 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.358605 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.358739 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.358866 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.358994 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.359151 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.359284 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.359453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.359576 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.359758 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.359889 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.360063 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.360216 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.360407 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.360532 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.360729 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.360852 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.361039 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.361172 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.361347 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.361471 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.361654 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.361790 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.361971 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:46:50.362108 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.362298 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.362420 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.362627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.362757 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.362940 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.363080 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.363252 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.363393 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.363576 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.363713 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.363873 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.363997 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.364224 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.364349 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.364550 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.364680 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.364866 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.364989 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.365179 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.365397 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.366010 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.366139 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.366322 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.366636 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.366797 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.366959 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.367180 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.367305 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.367517 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.367641 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.367845 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.367970 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.368186 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.368325 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.368535 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.368675 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.368869 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.368999 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.369156 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.369281 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.369488 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.369614 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.369813 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.369936 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.370128 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.370263 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.370470 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.370594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.370805 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.370941 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.371121 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.371243 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.371450 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.371575 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.371763 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.371894 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.372095 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.372220 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.372410 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.372532 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.372720 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.372855 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.373036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.373159 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.373349 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.373475 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.373671 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.373814 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.373971 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.374095 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.374282 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.374417 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.374610 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.374736 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.374926 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.375055 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.375237 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.375367 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.375551 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.375674 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.375864 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.375988 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.376201 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.376327 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.376515 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.376639 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.376826 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.376951 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.377139 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.377249 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.377512 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.377638 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.377742 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.377845 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.378046 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.378156 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.378358 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.378478 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.378664 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.378773 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.378978 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.379117 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.379287 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.379406 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.379595 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.379714 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.379903 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.380026 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.380241 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.380323 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.380548 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.380623 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.380856 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.380939 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.381740 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.381827 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.382046 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.382298 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.382372 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.382919 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383012 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383098 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383176 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383261 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383340 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383550 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383636 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383854 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.383950 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.384187 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.384288 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.384493 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.384577 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.384807 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.384898 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.385117 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.385201 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.385445 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.385578 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.385734 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.385866 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.386043 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.386166 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.386350 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.386480 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.386667 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.386798 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.386975 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.387106 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.387288 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.387412 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.387614 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.387756 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.387908 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.388065 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.388257 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.388380 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.388570 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.388710 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.388896 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.389041 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.389230 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.389355 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.389489 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.389682 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.389805 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.389933 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.390086 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.390210 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.390411 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.390538 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.390680 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.390804 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.390986 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.391110 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.391288 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.391414 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.391592 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.391724 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.391898 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.392022 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.392222 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.392349 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.392527 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.392654 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.392847 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.392971 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.393153 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.393287 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.393457 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.393582 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.393760 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.393907 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.394094 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.394219 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.394347 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.394467 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.394646 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.394781 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.394970 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.395095 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.395281 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.395405 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.395701 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.395815 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.395929 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.396050 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.396220 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.396341 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.396524 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.396661 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.396894 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.397039 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.397205 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.397338 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.397562 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.397693 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.397884 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.398007 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.398218 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.398343 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.398533 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.398658 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.398850 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.398982 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.399164 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.399369 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.399504 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.399627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.399778 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.399903 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.400106 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.400233 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.400440 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.400564 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.400750 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.400872 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.401074 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.401197 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.401388 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.401513 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.401712 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.401834 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.402023 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.402159 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.402335 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.402457 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.402646 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.402768 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.402955 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.403085 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.403265 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.403390 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.403578 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.403702 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.403889 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.404025 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.404237 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.404373 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.404529 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.404654 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.404852 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.404985 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.405162 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.405285 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.405476 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.405600 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.405783 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.405914 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.406095 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.406223 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.406397 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.406520 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.406713 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.406840 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.407032 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.407154 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.407346 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.407479 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.407658 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.407782 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.407970 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.408112 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.408314 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.408437 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.408624 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.408748 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.408930 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.409052 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.409244 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.409383 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.409578 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.409703 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.409845 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.409969 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.410155 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.410288 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.410470 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.410595 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.410779 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.410903 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.411090 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.411223 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.411398 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.411524 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.411714 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.411838 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.412023 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.412274 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.412402 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.412510 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.412763 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.413079 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.413198 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.413395 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.413508 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.413705 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.413817 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.414023 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.414147 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.414334 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.414454 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.414640 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.414750 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.414951 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.415076 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.415257 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.415375 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.415630 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.415756 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.415895 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.416015 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.416244 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.416354 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.416551 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.416662 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.416857 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.416982 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.417162 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.417272 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.417488 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.417575 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.417794 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.417879 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.418099 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.418181 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.418411 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.418495 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.418719 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.418805 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.419035 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.419125 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.419349 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.419442 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.419683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.419780 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.419967 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.420054 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.420308 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.420432 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.420619 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.420743 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.420931 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.421053 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.421241 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.421374 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.421554 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.421676 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.421868 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.421994 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.422183 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.422323 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.422494 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.422618 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.422804 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.422935 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.423143 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.423286 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.423408 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.423529 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.423719 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.423844 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.424039 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.424236 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.424381 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.424644 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.424773 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.424973 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.425106 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.425283 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.425407 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.425594 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.425730 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.425913 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.426051 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.426247 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.426471 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.426596 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.426807 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.426938 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.427127 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.427260 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.427449 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.427574 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.427790 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.427920 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.428664 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.428803 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.429000 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.429203 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.429355 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.429477 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.429636 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.429774 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.429969 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.430102 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.430231 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.430353 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.430537 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.430662 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.430840 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.430971 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.431144 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.431274 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.431451 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.431576 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.431758 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.431882 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.432068 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.432211 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.432396 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.432533 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.432705 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.432827 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.433008 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.433130 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.433312 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.433449 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.433621 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.433753 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.433924 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.434054 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.434230 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.434371 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.434545 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.434741 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.434865 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.434991 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.435149 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.435283 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.435462 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.435587 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.435768 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.435913 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.436091 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.436219 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.436403 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.436527 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.436748 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.436883 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.437057 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.437182 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.437363 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.437485 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.437669 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.437805 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.437974 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.438107 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.438287 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.438418 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.438597 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.438860 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.438995 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.439126 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.439247 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.439368 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.439487 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.439620 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.439788 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.439920 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.440153 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.440281 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.440402 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.440531 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.440704 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.440837 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.441011 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.441137 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.441328 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.441461 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.441641 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.441774 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.441946 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.442327 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.442513 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.442650 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.442822 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.442953 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.443128 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.443432 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.443562 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.444349 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.444454 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.444672 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.444779 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.444986 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.445075 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.445297 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.445382 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.445603 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.445687 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.445908 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.446013 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.446218 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.446303 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.446526 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.446624 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.446830 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.446916 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.447153 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.447238 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.447466 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.447564 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.447772 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.447858 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.448099 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.448199 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.448409 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.448502 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.448714 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.448807 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.449020 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.449113 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.449328 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.449423 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.449635 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.449725 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.449946 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.450031 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.450246 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.450339 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.450552 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.450643 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.450854 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.450937 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.451159 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.451252 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.451462 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.451546 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.451770 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.451854 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.452102 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.452191 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.452401 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.452485 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.452708 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.452794 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.453015 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.453105 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.453317 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.453401 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.453629 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.453732 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.453935 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.454020 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.454239 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.454322 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.454541 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.454633 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.454845 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.454931 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.455152 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.455241 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.455480 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.455575 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.455795 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.455887 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.456127 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.456220 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.456441 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.456539 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.456749 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.456833 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.457057 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.457149 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.457368 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.457466 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.457690 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.457791 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.457982 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.458066 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.458299 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.458385 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.458613 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.458697 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.458929 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.459016 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.459275 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.459368 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.459583 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.459763 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.459910 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.460096 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.460247 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.460433 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.460563 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.460750 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.460887 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.461070 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.461212 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.461380 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.461538 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.461691 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.461846 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.462018 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.462154 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.462332 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.462466 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.462649 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.462777 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.462973 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.463088 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.463298 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.463384 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.463630 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.463747 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.463939 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.464032 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.464287 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.464377 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.464600 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.464703 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.464908 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.465060 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.465218 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.465357 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.465524 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.465664 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.465833 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.465984 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.466119 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.466289 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.466426 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.466582 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.466726 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.466859 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.467028 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.467170 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.467334 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.467491 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.467635 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.467816 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.467956 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.468124 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.468267 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.468413 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.468566 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.468708 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.468873 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.469016 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.469242 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.469398 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.469535 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.469670 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.469803 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.469944 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.470087 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.470223 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.470374 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.470594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.470734 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.470869 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.471011 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.471155 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.471365 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.471505 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.471671 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.471812 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.471984 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.472147 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.472321 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.472482 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.472618 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.472751 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.472897 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.473032 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.473202 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.473352 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.473528 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.473742 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.473888 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.474031 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.474173 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.474309 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.474453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.474601 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.474736 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.474905 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.475048 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.475183 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.475384 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.475535 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.475762 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.475903 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.476069 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.476230 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.476397 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.476559 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.476696 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.476899 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.477048 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.477214 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.477364 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.477527 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.477668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.477848 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.478015 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.478156 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.478330 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.478472 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.478641 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.478786 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.479044 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.479187 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.479404 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.479547 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.479690 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.479828 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.479962 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.480123 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.480297 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.480439 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.480614 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.480819 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.480967 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.481103 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.481238 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.481374 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.481517 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.481652 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.481829 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.481970 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.482150 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.482303 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.482464 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.482617 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.482782 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.482924 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.483089 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.483240 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.483414 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.483565 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.483739 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.483882 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.484054 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.484301 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.484440 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.484574 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.484718 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.484862 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.484998 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.485141 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.485300 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.485522 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.485661 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.485805 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.485950 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.486122 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.486261 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.486395 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.486539 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.486682 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.486825 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.486968 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.487103 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.487244 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.487380 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.487520 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.487681 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.487882 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.488131 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.488285 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.488428 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.488574 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.488718 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.488890 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.489030 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.489165 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.489300 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.489528 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.489690 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.489874 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.490013 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.490148 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.490282 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.490979 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.491210 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.491352 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.491488 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.491624 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.491759 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.491903 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.492039 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.492205 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.492341 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.492500 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.492643 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.492828 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.492979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.493125 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.493273 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.493416 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.493560 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.493729 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.493870 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.494037 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.494187 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.494382 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.494534 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.494677 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.494821 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.494974 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.495110 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.495311 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.495464 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.495621 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.495771 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.495907 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.496042 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.496256 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.496408 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.496545 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.496680 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.496814 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.496959 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.497109 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.497245 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.497388 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.497530 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.497696 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.497838 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.498024 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.498166 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.498301 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.498437 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.498579 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.498716 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.498892 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.499035 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.499215 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.499357 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.499511 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.499728 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.499870 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.500005 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.500171 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.500319 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.500455 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.500598 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.500735 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.500885 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.501020 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.501162 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.501398 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.501548 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.501686 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.501821 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.501957 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.502092 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.502253 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.502404 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.502570 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.502722 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.502864 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.502998 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.503188 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.503329 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.503504 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.503647 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.503819 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.503961 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.504157 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.504299 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.504444 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.504578 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.504761 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.504909 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.505060 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.505195 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.505382 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.505524 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.505702 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.505899 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.506071 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.506795 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.506988 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.507179 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.507346 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.507494 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.507639 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.507774 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.507910 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.508044 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.508245 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.508393 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.508575 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.508716 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.508989 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.509130 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.509303 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.509468 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.509605 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.509759 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.509965 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.510106 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.510242 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.510387 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.510548 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.510721 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.510870 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.511047 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.511209 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.511382 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.511603 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.511751 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.511893 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.512036 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.512343 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.512494 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.512637 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.512790 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.512932 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.513083 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.513234 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.513387 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.513538 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.513688 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.513837 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.514052 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.514198 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.514340 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.514482 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.514624 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.514766 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.514921 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.515070 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.515243 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.515403 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.515403 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.515697 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.515839 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.515982 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.516151 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.516301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.516453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.516606 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.516755 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.516898 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.517056 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.517207 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.517364 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.517506 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.517654 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.517805 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.517947 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.518089 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.518281 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.518438 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.518581 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.518721 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.518863 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.519017 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.519169 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.519312 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.519454 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.519604 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.519755 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.519907 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.520182 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.520334 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.520488 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.520632 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.520773 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.520935 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.521078 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.521219 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.521416 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.521581 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.521833 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.522052 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.522245 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.522399 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.522544 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.522686 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.522828 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.522978 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.523131 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.523273 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.523425 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.523570 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.523720 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.523862 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.524017 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.524217 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.524403 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.524564 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.524752 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.524910 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.525078 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.525245 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.525398 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.525542 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.525717 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.525867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.526031 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.526187 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.526331 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.526472 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.526646 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.526798 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.526940 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.527101 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.527244 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.527480 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.527631 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.527832 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.527981 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.528164 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.528366 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.528523 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.528674 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.528825 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.528976 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.529119 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.529274 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.529426 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.529569 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.529710 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.529852 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.530002 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.530169 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.530394 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.530542 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.530684 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.530826 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.530969 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.531119 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.531273 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.531415 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.531556 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.531697 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.531855 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.532095 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.532250 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.532392 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.532534 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.532675 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.532817 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.532970 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.533114 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.533265 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.533408 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.533550 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.533692 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.533846 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.533989 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.534132 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.534274 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.534423 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.534574 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.534716 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.534857 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.535015 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.535158 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.535299 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.535457 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.535611 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.535753 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.535895 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.536036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.536230 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.536385 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.536528 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.536670 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.536812 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.536963 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.537113 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.537270 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.537440 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.537596 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.537738 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.537880 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.538030 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.538172 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.538314 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.538542 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.538690 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.538840 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.539009 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.539152 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.539303 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.539446 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.539587 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.539758 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.539914 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.540160 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.540314 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.540540 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.540698 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.540842 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.540996 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.541150 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.541300 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.541444 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.541585 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.541739 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.541881 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.542024 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.542252 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.542399 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.542541 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.542758 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.542902 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.543055 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.543204 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.543355 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.543498 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.543650 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.543793 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.543942 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.544103 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.544251 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.544393 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.544622 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.544771 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.544914 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.545074 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.545217 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.545367 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.545517 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.545663 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.545806 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.545954 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.546105 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.546256 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.546406 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.546556 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.546708 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.546860 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547002 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547152 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547290 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547389 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547475 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547556 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547726 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.547860 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.548037 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.548192 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.548376 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.548508 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.548694 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.548851 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.549004 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.549149 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.549343 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.549492 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.549665 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.549987 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.550140 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.550307 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.550455 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.550689 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.550851 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.550994 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.551135 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.551277 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.551426 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.551577 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.551720 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.551862 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.552005 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.552187 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.552416 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.552578 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.552733 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.552877 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.553548 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.553692 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.553843 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.554120 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.554269 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.554451 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.554600 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.554778 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.554941 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.555087 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.555230 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.555385 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.555529 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.555670 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.555821 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.555971 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.556137 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.556286 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.556429 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.556582 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.556726 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.556874 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.557042 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.557208 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.557376 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.557533 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.557717 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.557873 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.558049 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.558205 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.558347 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.558497 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.558686 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.558827 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.558977 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.559119 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.559271 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.559421 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.559571 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.559713 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.559862 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.560004 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.560194 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.560348 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.560492 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.560633 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.560861 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.561008 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.561159 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.561313 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.561456 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.561598 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.561747 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.561898 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.562049 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.562192 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.562334 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.562568 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.562719 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.562860 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.563011 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.563164 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.563306 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.563448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.563591 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.563745 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.563888 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.564029 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.564237 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.564388 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.564532 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.564682 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.564824 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.564966 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.565117 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.565259 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.565259 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.565539 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.565690 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.565832 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.565982 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.566124 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.566265 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.566418 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.566570 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.566713 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.566854 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.567274 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.567436 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.567587 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.567587 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.567868 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.568011 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.568207 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.568366 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.568510 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.569298 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.569396 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.569473 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.569553 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.569673 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.569764 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.569999 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.570094 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.570307 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.570404 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.570625 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.570723 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.570942 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.571037 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.571253 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.571348 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.571570 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.571665 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.571876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.571968 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.572211 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.572383 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.572520 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.572603 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.572830 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.572917 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.573141 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.573229 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.573455 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.573541 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.573764 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.573850 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.574075 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.574163 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.574391 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.574479 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.574705 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.575021 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.575116 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.575346 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.575438 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.575654 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.575739 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.575966 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.576061 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.576306 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.576395 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.576618 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.576718 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.576928 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.577015 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.577246 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.577339 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.577560 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.577672 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.577869 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.577956 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.578188 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.578276 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.578492 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.578589 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.578736 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 07:46:50.578823 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.579131 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.579445 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.579776 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.580130 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.580485 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.580800 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.581143 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.581476 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.581794 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.582108 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.582417 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:46:50.582662 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 07:46:50.732115 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO dbcounter [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Registered counter for database nova_api Sep 07 07:46:50.735220 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO dbcounter [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Registered counter for database nova_api Sep 07 07:46:50.755012 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_db.sqlalchemy.engines [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:50.756703 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_db.sqlalchemy.engines [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:50.761714 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writer thread running {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:50.763307 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writer thread running {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:50.823314 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.context [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b28c4aa-1c51-47f0-9ca4-409ec11b013c(cell1) {{(pid=105495) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 07:46:50.825604 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.context [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b28c4aa-1c51-47f0-9ca4-409ec11b013c(cell1) {{(pid=105494) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 07:46:50.827130 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_concurrency.lockutils [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:46:50.827603 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_concurrency.lockutils [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:46:50.829197 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_concurrency.lockutils [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:46:50.829475 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:46:50.829919 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_concurrency.lockutils [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:46:50.830021 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:46:50.830361 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_concurrency.lockutils [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:46:50.831496 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:46:50.832250 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:46:50.832355 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_concurrency.lockutils [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:46:50.832696 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:46:50.834445 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO dbcounter [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Registered counter for database nova_cell0 Sep 07 07:46:50.834774 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:46:50.836961 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO dbcounter [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Registered counter for database nova_cell0 Sep 07 07:46:50.838465 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO dbcounter [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Registered counter for database nova_cell1 Sep 07 07:46:50.841049 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO dbcounter [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Registered counter for database nova_cell1 Sep 07 07:46:50.845600 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_db.sqlalchemy.engines [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:50.848284 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_db.sqlalchemy.engines [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:50.849375 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_db.sqlalchemy.engines [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:50.852909 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writer thread running {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:50.853135 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_db.sqlalchemy.engines [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:50.855979 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writer thread running {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:50.992901 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writer thread running {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:50.995424 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writer thread running {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:51.002812 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO dbcounter [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Registered counter for database nova_cell0 Sep 07 07:46:51.004290 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO dbcounter [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Registered counter for database nova_cell0 Sep 07 07:46:51.011033 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG oslo_db.sqlalchemy.engines [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:51.012805 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_db.sqlalchemy.engines [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:46:51.015844 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writer thread running {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:51.017776 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writer thread running {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:46:51.356964 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: WARNING keystonemiddleware.auth_token [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:46:51.358393 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: WARNING keystonemiddleware.auth_token [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:46:51.364216 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: WARNING keystonemiddleware.auth_token [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:46:51.365657 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: WARNING keystonemiddleware.auth_token [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:46:51.714012 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: WARNING keystonemiddleware.auth_token [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:46:51.719943 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: WARNING keystonemiddleware.auth_token [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:46:51.725555 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563db4b9f9c0 pid: 105494 (default app) Sep 07 07:46:51.727629 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:46:51.728846 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Sep 07 07:46:51.729257 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Sep 7 07:46:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:46:51.731276 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: WARNING keystonemiddleware.auth_token [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:46:51.737212 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: WARNING keystonemiddleware.auth_token [None req-1d07342d-4c40-49c8-acee-ca134aa35e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:46:51.743571 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563db4b9f9c0 pid: 105495 (default app) Sep 07 07:48:13.664776 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:13.665690 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 07 07:48:13.666076 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:13.678883 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writing DB stats nova_api:SELECT=3 {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:13.679836 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writing DB stats nova_cell1:SELECT=3 {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:13.680605 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writing DB stats nova_cell0:SELECT=3 {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:13.681668 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:14.559173 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-c1e7306c-8c03-48bf-ae6b-629ed99694cb admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:14.592833 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-c1e7306c-8c03-48bf-ae6b-629ed99694cb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919989 Sep 07 07:48:14.593560 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 7 07:48:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:17.253353 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:17.254361 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-983acf4f-a351-4c56-becc-24e057c481e2 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 07 07:48:17.254933 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:17.700456 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-48c62de9-c89b-45f9-89f0-100d728880ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "id": "c1"}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:17.748664 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-48c62de9-c89b-45f9-89f0-100d728880ce admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487597 Sep 07 07:48:17.749225 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:48:17.762761 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_api:SELECT=3 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:17.765397 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_cell0:SELECT=3 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:17.766381 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_cell1:SELECT=3 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:17.766789 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:17.973205 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-2c9367f6-547e-49e0-95a5-84c735139f20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:18.042584 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-2c9367f6-547e-49e0-95a5-84c735139f20 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284953 Sep 07 07:48:18.043482 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 7 07:48:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:20.677549 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-48c62de9-c89b-45f9-89f0-100d728880ce admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:20.678568 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-48c62de9-c89b-45f9-89f0-100d728880ce admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 07 07:48:20.678966 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:21.322429 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-facf633f-6d63-4236-a03a-89c3b0188a12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:21.368015 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-facf633f-6d63-4236-a03a-89c3b0188a12 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.682508 Sep 07 07:48:21.368635 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:48:21.384738 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-48a9ac97-b04d-44e4-b336-3bfb1bd98be5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:21.427496 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-48a9ac97-b04d-44e4-b336-3bfb1bd98be5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049684 Sep 07 07:48:21.428098 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 7 07:48:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:24.063311 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-facf633f-6d63-4236-a03a-89c3b0188a12 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:24.064977 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-facf633f-6d63-4236-a03a-89c3b0188a12 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 07 07:48:24.065886 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:24.485429 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-06f8b6be-f8ff-452d-b011-8ffaa4f10963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:24.508092 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-06f8b6be-f8ff-452d-b011-8ffaa4f10963 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435323 Sep 07 07:48:24.508953 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:48:24.521366 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-e6e9a301-5ee0-4f78-aeca-952e0510fe41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:24.547350 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-e6e9a301-5ee0-4f78-aeca-952e0510fe41 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030133 Sep 07 07:48:24.547930 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 7 07:48:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:48:27.170179 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-06f8b6be-f8ff-452d-b011-8ffaa4f10963 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:27.171182 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-06f8b6be-f8ff-452d-b011-8ffaa4f10963 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 07 07:48:27.171577 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:27.606660 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-8c9d3ca3-4e81-44aa-9fbf-20b40d5e9d8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "id": "d3"}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:27.628646 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-8c9d3ca3-4e81-44aa-9fbf-20b40d5e9d8d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450244 Sep 07 07:48:27.629317 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:48:27.641385 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-a2fa38e1-b4ed-4f30-a6fc-fdb8de10265a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:27.667072 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-a2fa38e1-b4ed-4f30-a6fc-fdb8de10265a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029387 Sep 07 07:48:27.667637 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 7 07:48:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:30.301901 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-8c9d3ca3-4e81-44aa-9fbf-20b40d5e9d8d admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:30.302982 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-8c9d3ca3-4e81-44aa-9fbf-20b40d5e9d8d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 07 07:48:30.303422 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:30.732479 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-1568c5a5-a77c-46bb-9891-de493c5f3c7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "ram": 4096, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:30.756500 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-1568c5a5-a77c-46bb-9891-de493c5f3c7b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446397 Sep 07 07:48:30.757472 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:48:30.770750 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-0bed2c5e-6ef5-4f1c-ba47-6084701e6fec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:30.794925 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-0bed2c5e-6ef5-4f1c-ba47-6084701e6fec admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028736 Sep 07 07:48:30.795531 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 7 07:48:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:33.992613 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-1568c5a5-a77c-46bb-9891-de493c5f3c7b admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:33.993625 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-1568c5a5-a77c-46bb-9891-de493c5f3c7b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 07 07:48:33.994027 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:34.425292 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-a041d197-59ea-4e4d-b734-c81abddd0c98 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:34.449500 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-a041d197-59ea-4e4d-b734-c81abddd0c98 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449036 Sep 07 07:48:34.450104 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 7 07:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:48:37.307500 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-1568c5a5-a77c-46bb-9891-de493c5f3c7b admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:37.308545 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-1568c5a5-a77c-46bb-9891-de493c5f3c7b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 07 07:48:37.308950 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:37.719100 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-d6315692-ee13-4f18-8c4d-b73baa082d78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "id": "1", "name": "m1.tiny", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:37.736922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-d6315692-ee13-4f18-8c4d-b73baa082d78 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.421904 Sep 07 07:48:37.737653 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:48:37.749480 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-0fe50eb4-abe3-4902-958d-7ad1bfa07dec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:37.773787 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-0fe50eb4-abe3-4902-958d-7ad1bfa07dec admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028000 Sep 07 07:48:37.774690 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 7 07:48:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:40.394108 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-d6315692-ee13-4f18-8c4d-b73baa082d78 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:40.395112 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-d6315692-ee13-4f18-8c4d-b73baa082d78 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 07 07:48:40.395507 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:40.819325 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-bc5efabb-971e-4495-82ba-670460b849cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:40.843682 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-bc5efabb-971e-4495-82ba-670460b849cf admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.441540 Sep 07 07:48:40.846033 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:48:40.858137 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-c2a95f89-28f8-4a85-b0ab-a0dbc6ac5030 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:40.890442 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-c2a95f89-28f8-4a85-b0ab-a0dbc6ac5030 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035987 Sep 07 07:48:40.891317 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 7 07:48:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:43.584657 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-bc5efabb-971e-4495-82ba-670460b849cf admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:43.585664 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-bc5efabb-971e-4495-82ba-670460b849cf admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 07 07:48:43.591252 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:44.031010 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-b48dca3a-9a1b-49b3-820b-294a2f35010d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:44.054382 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-b48dca3a-9a1b-49b3-820b-294a2f35010d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.461911 Sep 07 07:48:44.054938 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:48:44.067588 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-28b93498-149b-4a55-8b4a-106d73b6b049 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:44.073735 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:44.097436 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-28b93498-149b-4a55-8b4a-106d73b6b049 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034011 Sep 07 07:48:44.100147 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 7 07:48:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:48:46.729943 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-b48dca3a-9a1b-49b3-820b-294a2f35010d admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:46.731733 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-b48dca3a-9a1b-49b3-820b-294a2f35010d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002216 Sep 07 07:48:46.732233 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:47.221513 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-bdfcaa20-99d4-4d8f-b968-1234bf2243c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "disk": 80, "name": "m1.large"}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:47.247750 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-bdfcaa20-99d4-4d8f-b968-1234bf2243c8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.508877 Sep 07 07:48:47.248454 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:48:47.260552 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-0b5b299e-9091-4568-b6da-d3722f04c369 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:47.286247 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-0b5b299e-9091-4568-b6da-d3722f04c369 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029253 Sep 07 07:48:47.286931 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 7 07:48:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:48:49.930212 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-bdfcaa20-99d4-4d8f-b968-1234bf2243c8 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:48:49.931217 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-bdfcaa20-99d4-4d8f-b968-1234bf2243c8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 07 07:48:49.931616 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:48:50.373663 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-29c40826-65cf-4b26-9539-17de12080f13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:50.380614 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:48:50.396337 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-29c40826-65cf-4b26-9539-17de12080f13 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458678 Sep 07 07:48:50.400224 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 7 07:48:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:48:50.409168 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-51ee4e2c-8f43-4e6d-b7c0-15960ab8818d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:48:50.445450 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-51ee4e2c-8f43-4e6d-b7c0-15960ab8818d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040086 Sep 07 07:48:50.446357 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 7 07:48:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:49:06.633110 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-29c40826-65cf-4b26-9539-17de12080f13 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:06.634121 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-29c40826-65cf-4b26-9539-17de12080f13 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 07 07:49:06.634516 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:49:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:06.644966 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:49:07.021549 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-422095a7-3fdb-4917-ae86-872bd8c6c117 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:07.039433 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-422095a7-3fdb-4917-ae86-872bd8c6c117 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398951 Sep 07 07:49:07.039961 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 7 07:49:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:49:08.366750 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-29c40826-65cf-4b26-9539-17de12080f13 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:08.367746 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-29c40826-65cf-4b26-9539-17de12080f13 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 07 07:49:08.368164 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:08.885937 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-ffc93a11-df7d-48f9-9bb1-be09157304a2 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:08.891638 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.wsgi [None req-ffc93a11-df7d-48f9-9bb1-be09157304a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-ffc93a11-df7d-48f9-9bb1-be09157304a2 admin admin] Request method failure captured: Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Accept: application/json Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Accept-Encoding: gzip, deflate Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Connection: keep-alive Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Content-Length: 0 Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Host: 10.222.0.26 Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Openstack-Api-Version: compute 2.92 Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Openstack-System-Scope: None Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: User-Agent: python-novaclient Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Auth-Token: gAAAAABjGEz0mkLU989ie3pZEXEGjCogXZSzLEiwGSEDVAug1Vf9hLFpyMhgIHC6Vwgo4-oA9GchQKF80teiU8gkPoYckS99HpXd8gup7ipE-DisvR2M6-8T9_tey9GigOtVkBhuex3xlGpUfcFVj-jmudXp_LnYaVW6TKTsomIYluwnD58c1pY Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Domain-Id: None Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Domain-Name: None Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Identity-Status: Confirmed Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Is-Admin-Project: True Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Domain-Id: default Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Domain-Name: Default Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Name: admin Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Role: reader,member,admin Sep 07 07:49:08.894876 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Roles: reader,member,admin Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bb18598c40b6447faef02991e1b9c4ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant: admin Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant-Name: admin Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User: admin Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Domain-Id: default Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Domain-Name: Default Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Id: 984123d0eaef4929af01f39a46ebd51e Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Name: admin Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: method: > Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: exception: Flavor 42 could not be found. Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: action_args: {'id': '42'} Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:49:08.896453 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:08.897594 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.898979 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-ffc93a11-df7d-48f9-9bb1-be09157304a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:49:08.900241 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-ffc93a11-df7d-48f9-9bb1-be09157304a2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390176 Sep 07 07:49:08.900241 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 7 07:49:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 07:49:08.906294 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-3c792457-3b96-4819-a46a-779b366ccc55 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:08.929197 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-3c792457-3b96-4819-a46a-779b366ccc55 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026693 Sep 07 07:49:08.929927 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 7 07:49:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:49:08.940272 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-ce583fd6-0849-4e9d-8555-617596797075 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:08.963143 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-ce583fd6-0849-4e9d-8555-617596797075 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027357 Sep 07 07:49:08.963676 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 7 07:49:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:49:08.973727 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-5ecc13fe-090b-4ef2-9d5d-91fa09228f95 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:08.979553 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.wsgi [None req-5ecc13fe-090b-4ef2-9d5d-91fa09228f95 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-5ecc13fe-090b-4ef2-9d5d-91fa09228f95 admin admin] Request method failure captured: Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Accept: application/json Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Accept-Encoding: gzip, deflate Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Connection: keep-alive Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Content-Length: 0 Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Host: 10.222.0.26 Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Openstack-Api-Version: compute 2.92 Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Openstack-System-Scope: None Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: User-Agent: python-novaclient Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Auth-Token: gAAAAABjGEz0mkLU989ie3pZEXEGjCogXZSzLEiwGSEDVAug1Vf9hLFpyMhgIHC6Vwgo4-oA9GchQKF80teiU8gkPoYckS99HpXd8gup7ipE-DisvR2M6-8T9_tey9GigOtVkBhuex3xlGpUfcFVj-jmudXp_LnYaVW6TKTsomIYluwnD58c1pY Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Domain-Id: None Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Domain-Name: None Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Identity-Status: Confirmed Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Is-Admin-Project: True Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Domain-Id: default Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Domain-Name: Default Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Name: admin Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Role: reader,member,admin Sep 07 07:49:08.982801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Roles: reader,member,admin Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bb18598c40b6447faef02991e1b9c4ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant: admin Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant-Name: admin Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User: admin Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Domain-Id: default Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Domain-Name: Default Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Id: 984123d0eaef4929af01f39a46ebd51e Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Name: admin Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: method: > Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: exception: Flavor 42 could not be found. Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: action_args: {'id': '42'} Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:49:08.984301 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:08.985668 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:08.986855 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-5ecc13fe-090b-4ef2-9d5d-91fa09228f95 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:49:08.987800 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-5ecc13fe-090b-4ef2-9d5d-91fa09228f95 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014844 Sep 07 07:49:08.987800 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 7 07:49:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 07:49:10.208314 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-ce583fd6-0849-4e9d-8555-617596797075 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:10.209318 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-ce583fd6-0849-4e9d-8555-617596797075 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 07 07:49:10.209710 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:10.740419 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-29dcb3a2-c988-4877-9c96-d67c781ec7be admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:10.745749 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.wsgi [None req-29dcb3a2-c988-4877-9c96-d67c781ec7be admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-29dcb3a2-c988-4877-9c96-d67c781ec7be admin admin] Request method failure captured: Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Accept: application/json Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Accept-Encoding: gzip, deflate Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Connection: keep-alive Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Content-Length: 0 Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Host: 10.222.0.26 Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Openstack-Api-Version: compute 2.92 Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Openstack-System-Scope: None Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: User-Agent: python-novaclient Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Auth-Token: gAAAAABjGEz2pm9Hn_8KJw4h3Wq9egFx85eqwrgrSIDfC-v2CKhdtRXR0VMq6JMOyv5H6BJ4NHSsvZr46Hct_CkcBX0pBv23ehwrJuUBGhwhWOCmwtL76BrJsjXBNf_XyAy--WXHoVyNElk-sNdTCd5ZcECEiO_NxscSGH9v_pqx1HO_wl6h_Qg Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Domain-Id: None Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Domain-Name: None Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Identity-Status: Confirmed Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Is-Admin-Project: True Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Domain-Id: default Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Domain-Name: Default Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Name: admin Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Role: reader,member,admin Sep 07 07:49:10.747228 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Roles: reader,member,admin Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bb18598c40b6447faef02991e1b9c4ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant: admin Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant-Name: admin Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User: admin Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Domain-Id: default Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Domain-Name: Default Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Id: 984123d0eaef4929af01f39a46ebd51e Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Name: admin Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: method: > Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: exception: Flavor 84 could not be found. Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: action_args: {'id': '84'} Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:49:10.748683 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:10.749489 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.750867 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-29dcb3a2-c988-4877-9c96-d67c781ec7be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:49:10.752265 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-29dcb3a2-c988-4877-9c96-d67c781ec7be admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.399193 Sep 07 07:49:10.752265 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 7 07:49:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 07:49:10.758431 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-f08285c2-fc5b-4cf3-bc2c-c74f98b53ea3 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:10.773141 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-f08285c2-fc5b-4cf3-bc2c-c74f98b53ea3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018294 Sep 07 07:49:10.773668 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 7 07:49:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:49:10.783431 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-95da1623-815a-474d-a127-74361d7ccfb8 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:10.799371 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-95da1623-815a-474d-a127-74361d7ccfb8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019997 Sep 07 07:49:10.799898 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 7 07:49:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:49:10.809020 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-4d9bdb70-6df6-467f-9ae1-9c3d2b575619 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:10.814330 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.wsgi [None req-4d9bdb70-6df6-467f-9ae1-9c3d2b575619 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-4d9bdb70-6df6-467f-9ae1-9c3d2b575619 admin admin] Request method failure captured: Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Accept: application/json Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Accept-Encoding: gzip, deflate Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Connection: keep-alive Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Content-Length: 0 Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Host: 10.222.0.26 Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Openstack-Api-Version: compute 2.92 Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Openstack-System-Scope: None Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: User-Agent: python-novaclient Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Auth-Token: gAAAAABjGEz2pm9Hn_8KJw4h3Wq9egFx85eqwrgrSIDfC-v2CKhdtRXR0VMq6JMOyv5H6BJ4NHSsvZr46Hct_CkcBX0pBv23ehwrJuUBGhwhWOCmwtL76BrJsjXBNf_XyAy--WXHoVyNElk-sNdTCd5ZcECEiO_NxscSGH9v_pqx1HO_wl6h_Qg Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Domain-Id: None Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Domain-Name: None Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Identity-Status: Confirmed Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Is-Admin-Project: True Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Domain-Id: default Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Domain-Name: Default Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Name: admin Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Role: reader,member,admin Sep 07 07:49:10.816053 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Roles: reader,member,admin Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bb18598c40b6447faef02991e1b9c4ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant: admin Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant-Name: admin Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User: admin Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Domain-Id: default Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Domain-Name: Default Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Id: 984123d0eaef4929af01f39a46ebd51e Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Name: admin Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: method: > Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: exception: Flavor 84 could not be found. Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: action_args: {'id': '84'} Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:49:10.817627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:10.818595 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:10.820036 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-4d9bdb70-6df6-467f-9ae1-9c3d2b575619 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:49:10.821268 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-4d9bdb70-6df6-467f-9ae1-9c3d2b575619 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011945 Sep 07 07:49:10.821268 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 7 07:49:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 07 07:49:12.059849 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-95da1623-815a-474d-a127-74361d7ccfb8 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:12.060925 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-95da1623-815a-474d-a127-74361d7ccfb8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 07 07:49:12.061317 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:12.597330 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-c973ab3f-5f90-4556-bc7f-0f6501e8163d admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:12.603000 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.wsgi [None req-c973ab3f-5f90-4556-bc7f-0f6501e8163d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-c973ab3f-5f90-4556-bc7f-0f6501e8163d admin admin] Request method failure captured: Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Accept: application/json Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Accept-Encoding: gzip, deflate Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Connection: keep-alive Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Content-Length: 0 Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Host: 10.222.0.26 Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Openstack-Api-Version: compute 2.92 Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Openstack-System-Scope: None Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: User-Agent: python-novaclient Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Auth-Token: gAAAAABjGEz3-SzQWceMWkv8SS-NxTjQ-pTWsCgB0qhdGvY_Hpl6bTHSZiI7gbk7rPyMd9bsrDmd172wTaQN-cK4v85bpktsMEGeaJUhD63qO5YYqpbsh8OD0hHTRQrVN6efoPRinx1zSf1uoGpWB0cZiaLujpigDjSyLm24fstvgUi1roXEwzI Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Domain-Id: None Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Domain-Name: None Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Identity-Status: Confirmed Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Is-Admin-Project: True Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Domain-Id: default Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Domain-Name: Default Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Project-Name: admin Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Role: reader,member,admin Sep 07 07:49:12.604509 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Roles: reader,member,admin Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bb18598c40b6447faef02991e1b9c4ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant: admin Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-Tenant-Name: admin Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User: admin Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Domain-Id: default Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Domain-Name: Default Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Id: 984123d0eaef4929af01f39a46ebd51e Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: X-User-Name: admin Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: method: > Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: exception: Flavor 451 could not be found. Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: action_args: {'id': '451'} Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:49:12.606022 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:12.606921 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.608338 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-c973ab3f-5f90-4556-bc7f-0f6501e8163d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:49:12.609552 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-c973ab3f-5f90-4556-bc7f-0f6501e8163d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.408670 Sep 07 07:49:12.609552 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 7 07:49:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 07:49:12.616138 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-39ef4fb1-ad78-4b8a-98b7-9a74f8414ec5 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:12.631761 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-39ef4fb1-ad78-4b8a-98b7-9a74f8414ec5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019149 Sep 07 07:49:12.632330 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 7 07:49:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:49:12.641688 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:12.656110 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018095 Sep 07 07:49:12.656632 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 7 07:49:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:49:12.665512 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-31ccf167-5172-476a-826b-dd809155f8f2 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:12.670887 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.wsgi [None req-31ccf167-5172-476a-826b-dd809155f8f2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-31ccf167-5172-476a-826b-dd809155f8f2 admin admin] Request method failure captured: Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Accept: application/json Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Accept-Encoding: gzip, deflate Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Connection: keep-alive Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Content-Length: 0 Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Host: 10.222.0.26 Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Openstack-Api-Version: compute 2.92 Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Openstack-System-Scope: None Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: User-Agent: python-novaclient Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Auth-Token: gAAAAABjGEz3-SzQWceMWkv8SS-NxTjQ-pTWsCgB0qhdGvY_Hpl6bTHSZiI7gbk7rPyMd9bsrDmd172wTaQN-cK4v85bpktsMEGeaJUhD63qO5YYqpbsh8OD0hHTRQrVN6efoPRinx1zSf1uoGpWB0cZiaLujpigDjSyLm24fstvgUi1roXEwzI Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Domain-Id: None Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Domain-Name: None Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Identity-Status: Confirmed Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Is-Admin-Project: True Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Domain-Id: default Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Domain-Name: Default Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Project-Name: admin Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Role: reader,member,admin Sep 07 07:49:12.672922 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Roles: reader,member,admin Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bb18598c40b6447faef02991e1b9c4ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bb18598c40b6447faef02991e1b9c4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant: admin Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant-Id: bb18598c40b6447faef02991e1b9c4ed Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-Tenant-Name: admin Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User: admin Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Domain-Id: default Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Domain-Name: Default Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Id: 984123d0eaef4929af01f39a46ebd51e Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: X-User-Name: admin Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: method: > Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: exception: Flavor 451 could not be found. Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: action_args: {'id': '451'} Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:49:12.674453 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:12.675448 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: ERROR nova.api.openstack.wsgi Sep 07 07:49:12.676586 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-31ccf167-5172-476a-826b-dd809155f8f2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:49:12.677580 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-31ccf167-5172-476a-826b-dd809155f8f2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012358 Sep 07 07:49:12.677580 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 7 07:49:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 07:49:13.880224 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:13.881229 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 07 07:49:13.881627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:14.412680 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-6e9f00cc-bbea-4bd2-bbf6-8ede8bd26670 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:49:14.434901 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-6e9f00cc-bbea-4bd2-bbf6-8ede8bd26670 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.416207 Sep 07 07:49:14.435446 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 7 07:49:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:49:15.651685 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:15.652708 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 07 07:49:15.653103 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:16.174339 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-9051f049-ca32-4128-8216-593015bb5871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:49:16.192955 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-9051f049-ca32-4128-8216-593015bb5871 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402345 Sep 07 07:49:16.193488 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 7 07:49:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:49:17.428994 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:17.429988 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 07 07:49:17.430381 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:17.953394 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-30b37f04-c8b4-4023-8a5f-65f97c5edee0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:49:17.972941 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-30b37f04-c8b4-4023-8a5f-65f97c5edee0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.405212 Sep 07 07:49:17.973513 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 7 07:49:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:49:19.192965 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:19.193984 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 07 07:49:19.194377 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:19.709347 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-ac8399eb-64f5-4832-8c8e-ec07fc3f698f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:49:19.727989 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-ac8399eb-64f5-4832-8c8e-ec07fc3f698f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398374 Sep 07 07:49:19.728565 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 7 07:49:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:49:20.980235 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:20.981238 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 07 07:49:20.981628 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:49:21.498432 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-826a1824-57c2-40ae-8e20-03795d0aff6a admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:49:21.519274 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-826a1824-57c2-40ae-8e20-03795d0aff6a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399969 Sep 07 07:49:21.519801 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Sep 7 07:49:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:50:19.027218 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:50:19.028175 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-2944d90c-c9f4-4cf2-8bd8-efeeb5b97799 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 07 07:50:19.028590 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 7 07:50:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:50:19.039051 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:50:19.422557 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-745f6654-39e8-41ad-93f7-754c7ebba213 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:50:19.443327 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-745f6654-39e8-41ad-93f7-754c7ebba213 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408687 Sep 07 07:50:19.443860 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 7 07:50:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:50:19.464968 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG dbcounter [-] [105495] Writing DB stats nova_api:SELECT=14 {{(pid=105495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:50:19.468993 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-d5ad6d63-d71c-461b-80f7-c7dc967cb5db admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:50:19.476639 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-d5ad6d63-d71c-461b-80f7-c7dc967cb5db admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013092 Sep 07 07:50:19.477155 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Sep 7 07:50:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:50:19.488688 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-a753bdd3-9b45-4207-8b0b-c11eea380479 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:50:19.496216 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-a753bdd3-9b45-4207-8b0b-c11eea380479 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011022 Sep 07 07:50:19.496726 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Sep 7 07:50:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:50:19.508583 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:50:19.516660 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011573 Sep 07 07:50:19.517170 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Sep 7 07:50:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:50:19.528015 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-7ddb1ebc-f604-40fd-b7c7-361a556b504b admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:50:19.536169 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-7ddb1ebc-f604-40fd-b7c7-361a556b504b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011418 Sep 07 07:50:19.536695 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Sep 7 07:50:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:53:14.653848 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:14.655229 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001821 Sep 07 07:53:14.655627 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:53:14.800328 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_api:SELECT=6 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:53:14.963895 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:14.967260 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:14.967724 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:14.968206 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:14.968903 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:14.969334 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:14.969738 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:15.006194 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-198fb461-5760-419e-8f8a-4126968edd21 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.207244 Sep 07 07:53:15.006761 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 7 07:53:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:53:16.087173 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:16.088764 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 07 07:53:16.089162 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:53:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:53:16.288250 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:16.291832 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:16.292417 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:16.292862 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:16.293569 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:16.294005 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:16.294470 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:16.314541 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-36decee0-4c44-445e-afac-6d8921648c2c admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.080209 Sep 07 07:53:16.315103 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 7 07:53:16 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:53:27.796915 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:27.797916 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 07 07:53:27.798310 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:53:27.940678 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_cell0:SELECT=4 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:53:27.941317 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_cell1:SELECT=4 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:53:27.941916 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG dbcounter [-] [105494] Writing DB stats nova_api:SELECT=8 {{(pid=105494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:53:27.990162 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:27.993573 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:27.994074 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:27.994499 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:27.995207 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:27.995658 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:27.996056 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:28.020903 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-742e1581-e0f8-4222-b224-a2d0aeea2b20 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.084659 Sep 07 07:53:28.021446 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 7 07:53:27 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:53:29.096695 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: DEBUG nova.api.openstack.wsgi [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] Calling method '>' {{(pid=105495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:29.097706 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: INFO nova.api.openstack.requestlog [None req-d0201434-5196-42c9-a809-4b1d2e76e83f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 07 07:53:29.098106 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: [pid: 105495|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 7 07:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:53:29.288581 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG nova.api.openstack.wsgi [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] Calling method '>' {{(pid=105494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:53:29.292094 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:29.292571 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:29.292989 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:29.293688 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:53:29.294128 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:53:29.294533 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: DEBUG oslo_concurrency.lockutils [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:53:29.315988 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: INFO nova.api.openstack.requestlog [None req-a39ed5f0-d6ce-44bb-b648-cb409d6952a4 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.080396 Sep 07 07:53:29.316491 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: [pid: 105494|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 7 07:53:29 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:54:25.790916 dv-cinder-836027-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 07:54:25.791975 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: Wed Sep 7 07:54:25 2022 - graceful shutdown triggered... Sep 07 07:54:25.792603 dv-cinder-836027-10-iscsi devstack@n-api.service[105494]: Gracefully killing worker 1 (pid: 105494)... Sep 07 07:54:25.793108 dv-cinder-836027-10-iscsi devstack@n-api.service[105495]: Gracefully killing worker 2 (pid: 105495)... Sep 07 07:54:26.792746 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: worker 1 buried after 1 seconds Sep 07 07:54:26.793201 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: worker 2 buried after 1 seconds Sep 07 07:54:26.793201 dv-cinder-836027-10-iscsi devstack@n-api.service[105493]: goodbye to uWSGI. Sep 07 07:54:26.794417 dv-cinder-836027-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 07:54:26.794957 dv-cinder-836027-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 07:54:26.797711 dv-cinder-836027-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 07:54:26.807723 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 07:54:26.810890 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 07:54:26 2022] *** Sep 07 07:54:26.811060 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 07:54:26.811295 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 07:54:26.811476 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: nodename: dv-cinder-836027-10-iscsi Sep 07 07:54:26.811628 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: machine: x86_64 Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: clock source: unix Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: pcre jit disabled Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: detected number of CPU cores: 4 Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: current working directory: / Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: detected binary path: /usr/bin/uwsgi-core Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: your processes number limit is 47680 Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: your memory page size is 4096 bytes Sep 07 07:54:26.811759 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: detected max file descriptor number: 2048 Sep 07 07:54:26.812344 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: lock engine: pthread robust mutexes Sep 07 07:54:26.812344 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: thunder lock: enabled Sep 07 07:54:26.812344 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 07:54:26.812344 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 07:54:26.852053 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: Python main interpreter initialized at 0x55aad51af9c0 Sep 07 07:54:26.852053 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: python threads support enabled Sep 07 07:54:26.852053 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: your server socket listen backlog is limited to 100 connections Sep 07 07:54:26.852053 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: your mercy for graceful operations on workers is 90 seconds Sep 07 07:54:26.852464 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 07:54:26.852464 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: *** Operational MODE: preforking *** Sep 07 07:54:26.852749 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: *** uWSGI is running in multiple interpreter mode *** Sep 07 07:54:26.852918 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: spawned uWSGI master process (pid: 120474) Sep 07 07:54:26.853238 dv-cinder-836027-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 07:54:26.856501 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: spawned uWSGI worker 1 (pid: 120494, cores: 1) Sep 07 07:54:26.856966 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: spawned uWSGI worker 2 (pid: 120495, cores: 1) Sep 07 07:54:26.857178 dv-cinder-836027-10-iscsi devstack@n-api.service[120474]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 07:54:27.520801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 07:54:27.532345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 07:54:28.683428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:54:28.683428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: from cryptography.utils import int_from_bytes Sep 07 07:54:28.684033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:54:28.684033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: from cryptography.utils import int_from_bytes Sep 07 07:54:28.692727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:54:28.692727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: from cryptography.utils import int_from_bytes Sep 07 07:54:28.693209 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 07:54:28.693209 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: from cryptography.utils import int_from_bytes Sep 07 07:54:31.139573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 07:54:31.140236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 07:54:31.140405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 07:54:31.140773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 07:54:31.141034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 07:54:31.141427 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.141759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.142081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.142405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.142740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.143058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.143384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.143705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.144040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.144332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.144652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.145140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-10-iscsi {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.145471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.145788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.146118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.146447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.146759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.147089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.147403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.147918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.148403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.148718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.149037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.149395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.149701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.150016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.150343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.150658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.150989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.151302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.152260 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-10-iscsi {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.152589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.152912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.153236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.153660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.153976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.154290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.154620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.154948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.155264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.155618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.155752 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 07:54:31.156178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.156291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 07:54:31.156385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.156568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 07:54:31.156704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.156902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.157008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 07:54:31.157185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 07:54:31.157293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.157518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.157622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.157845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.157950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.158156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.158256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.158467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.158569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.158741 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.158838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.159023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.159143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.159353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.159459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.159681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.159792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.160010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.160144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.160291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.160399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.160548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.160683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.160874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.161146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-10-iscsi {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.161249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.161485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.161585 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.161798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.161895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.162110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.162221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.162420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.162520 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.162730 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.162822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.163041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.163144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.163352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.163445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.163662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.163870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.163984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.164263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.164370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.164582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.164688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.164901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.165095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.165276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.165378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.165560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.165650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.165880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.165981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.166195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.166286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.166508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.166619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.166856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.167746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.167905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.168073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.168351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.168458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.168719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.168849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-10-iscsi {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.169033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.169184 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.169347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.169515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.169673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.169845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.170012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.170270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.170369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.170565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.170655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.170872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.170970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.171181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.171283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.171507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.171600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.171817 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.171915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.172150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.172294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.172465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.172568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.172764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.172857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.173076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.173172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.173392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.173493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.173703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.173807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.174006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.174107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.174314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.174411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.174624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.174720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.174933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.175037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.175196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.175308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.175518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.175615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.175831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.175936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.176185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.176287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.176513 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.176600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.176768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.176872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.177029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.177162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.177360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.177531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.177692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.177836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.178010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.178109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.178317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.178474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.178608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.178747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.178915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.179062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.179227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.179361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.179533 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.179671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.179844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.179982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.180166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.180266 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.180473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.180563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.180796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.180888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.181099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.181199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.181409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.181498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.181731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.181821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.182041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.182137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.182349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.182446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.182682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.182810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.182991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.183332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.183458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.183872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.183976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.184067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.184193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.184394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.184492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.184702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.184799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.185027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.185118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.185357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.185457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.185666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.185757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.185979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.186077 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.186290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.186379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.186615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.186712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.186871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.186967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.187187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.187345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.187482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.187647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.187815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.187939 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.188149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.188313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.188470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.188652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.188786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.188979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.189085 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.189298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.189400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.189617 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.189720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.189951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.190043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.190270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.190377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.190587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.190684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.190901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.191005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.191210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.191299 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.191523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.191623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.191836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.191938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.192443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.192600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.192768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.192913 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.193094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.193249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.193389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.193539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.193705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.193840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.194080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.194231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.194378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.194524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.194747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.194902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.195040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.195189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.195327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.195464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.195616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.195751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.195900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.196035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.196153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.196306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.196477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.196625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.196790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.196950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.197105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.197313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.197424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.197611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.197730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.197929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.198026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.198781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.198981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.199112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.199432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.199528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.199765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.199871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.200103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.200209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.200421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.200520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.200736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.200828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.201052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.201152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.201365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.201455 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.201674 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.201763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.201985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.202084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.202313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.202405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.202645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.202756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.202959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.203048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.203271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.203360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.203585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.203694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.203902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.203992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 07:54:31.204248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.204420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.204577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.204729 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.204871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.205013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.205153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.205302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.205442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.205598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.205748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.205912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.206072 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.206227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.206376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.206553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.206689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.206876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.207011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.207216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.207353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.207539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.207650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.207860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.208003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.208202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.208313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.208528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.208618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.208855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.208953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.209171 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.209274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.209484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.209580 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.209815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.209906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.210132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.210223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.210446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.210542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.210770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.210865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.211078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.211178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.211392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.211482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.211711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.211801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.212028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.212158 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.212369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.212460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.212685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.212787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.212998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.213100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.213329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.213422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.213646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.213745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.214517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.214721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.214869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.215183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.215341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.215498 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.215638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.215809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.215952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.216164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.216285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.216488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.216581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.216798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.216888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.217114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.217220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.217429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.217535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.217744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.217846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.218052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.218157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.218365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.218456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.218674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.218772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.218985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.219089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.219295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.219393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.219607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.219706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.219916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.220022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.220273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.220385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.220590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.220688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.220900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.221005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.221211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.221314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.221520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.221622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.221832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.221930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.222149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.222247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.222466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.222564 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.222787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.222919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.223111 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.223210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.223442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.223538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.223770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.223860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.224102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.224207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.224421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.224511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.224744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.224835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.225047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.225137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.225363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.225466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.225685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.225776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.226000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.226108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.226323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.226428 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.226638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.226734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.226953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.227048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.227280 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.227378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.227598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.227702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.227906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.228005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.228258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.228368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.228575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.228671 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.228892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.228982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.229217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.229311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.229604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.229702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.229922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.230167 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.230267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.230547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.230644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.230865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.230966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.231180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.231280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.231496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.231587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.231814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.231902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.232146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.232254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.232471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.232561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.232787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.232885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.233119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.233226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.233434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.233526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.233758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.233859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.234068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.234167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.234385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.234475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.234695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.234849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.235011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.235109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.235324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.235415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.235642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.235733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.235956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.236055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.236302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.236429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.236613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.236711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.236927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.237017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.237235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.237323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.237546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.237648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.237861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.237960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.238173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.238303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.238486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.238590 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.238795 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.238884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.239102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.239192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.239422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.239521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.239736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.239832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.240046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.240170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.240377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.240481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.240694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.240792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.241022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.241112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.241338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.241429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.241667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.241768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.241995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.242116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.242306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.242400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.242616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.242706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.242944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.243032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.243256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.243354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.243565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.243656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.243874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.243972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.244205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.244311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.244537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.244638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.244858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.245011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.245287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.245384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.245505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.245800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.245915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.246136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.246234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.246455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.246582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.246822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.247042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.247159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.247368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.247465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.247699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.247806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.248035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.248171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.248372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.248485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.248670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.248764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.248988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.249091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.249307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.249447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.249623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.249724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.249948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.250040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.250261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.250353 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.250579 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.250679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.250893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.251006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.251202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.251302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.251518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.251657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.251836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.251937 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.252194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.252443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.252563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.252784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.252956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.253105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.253350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.253440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.253523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.253758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.253859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.254079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.254180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.254398 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.254490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.254713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.254805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.255032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.255212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.255373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.255517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.255659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.255798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.255938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.256113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.256259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.256408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.256591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.256745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.256886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.256994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.257201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.257308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.257509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.257601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.257818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.257919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.258124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.258216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.258515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.258628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.258747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.258848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.259058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.259150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.259379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.259524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.259688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.259782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.260000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.260113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.260336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.260439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.260661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.261238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.261485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.261668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.261795 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.262108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.262215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.262417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.262510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.262767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.262860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.263077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.263172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.263393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.263550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.263717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.263855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.264048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.264210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.264393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.264486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.264703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.264801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.265023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.265158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.265331 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.265433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.265641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.265732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.265952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.266052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.266268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.266366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.266583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.266750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.266880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.266967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.267194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.267320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.267509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.267608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.267828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.267920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.268175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.268326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.268477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.268637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.268792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.268893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.269101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.269200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.269417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.269521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.269731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.269831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.270040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.270352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.270468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.270644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.270743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.270952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.271044 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.271262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.271407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.271576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.271668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.271883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.271987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.272226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.272320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.272539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.272638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.272847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.272940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.273157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.273247 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.273520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.273615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.273783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.273885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.274090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.274189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.274411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.274509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.274723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.274814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.275034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.275124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.275338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.275430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.275649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.275742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.275956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.276054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.276288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.276593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.276926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.277324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.277566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.277666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.278406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.278525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.278749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.278889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.279061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.279151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.279387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.279492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.279704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.279793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.280018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.280160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.280360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.280460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.280670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.280767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.280982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.281072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.281297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.281398 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.281610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.281708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.281924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.282016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.282239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.282331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.282570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.282670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.282889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.282987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.283202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.283295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.283516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.283623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.283830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.283940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.284174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.284268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.284495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.288701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.288853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.288999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.289980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.290956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291299 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.291886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.292970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.293981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294534 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.294898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.295018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.295112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.295340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.295470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.295653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.295779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.295961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.296065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.296309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.296403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.296621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.296709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.296933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.297076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.297243 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.297335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.297556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.297645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.297865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.297968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.298174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.298318 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.298487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.298638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.298800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.298968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.299117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.299276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.299430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.299593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.299809 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.299914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.300153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.300250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.300470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.300576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.300783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.300885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.301138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.301263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.301452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.301582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.301821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.301916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.302139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.302240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.302465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.302567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.302794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.302896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.303107 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.303199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.303425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.303525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.303737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.303829 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.304049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.304185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.304377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.304478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.304705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.304797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.305012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.305104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.305326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.305427 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.305639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.305747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.305972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.306077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.306290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.306393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.306614 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.306764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.306943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.307086 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.307265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.307425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.307626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.307767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.308071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.308198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.308425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.308519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.308737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.308836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.309065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.309171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.309382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.309486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.309713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.309814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.310046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.310152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.310361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.310453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.310678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.310775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.310989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.311087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.311311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.311448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.311617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.311757 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.311938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.312039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.312283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.312378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.312599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.312790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.312935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.313122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.313255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.313439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.313569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.313767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.313887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.314114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.314225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.314408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.314508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.314721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.314819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.315040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.315242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.315531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.315714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.315850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.315952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.316462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.316651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.316755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.316841 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.316926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.317608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.317713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.317810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.317905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.318001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.318089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.318277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.318379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.318607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.318809 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.318915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.319154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.319323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.319560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.319713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.319871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.320022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.320150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.320239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.320413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.320506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.320735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.320840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.321070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.321170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.321387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.321485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.321714 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.321872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.321995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.322111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.322459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.322554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.322772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.322865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.323099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.323711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.323973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.324341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.324459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.324751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.324844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.325131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.325570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.325898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.326025 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.326223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.326386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.326565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.326732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.326903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.327109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.327248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.327568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.327891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.328223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.328338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.328564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.328661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.328886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.328977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.329209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.329537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.329856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.330012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.330193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.330355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.330530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.330686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.330857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.331193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.331622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.331806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.331943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.332164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.332299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.332499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.332632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.332829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.332970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.333150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.333288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.333472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.333603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.333829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.333937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.334133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.334225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.334471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.334566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.334794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.334895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.335112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.335211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.335429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.335527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.335747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.335840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.336063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.336207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.336403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.336504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.336719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.336813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.337058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.337157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.337371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.337463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.337703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.337804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.338022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.338113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.338344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.338434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.338666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.338759 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.339665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.339775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.339992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.340328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.340424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.340647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.340738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.340969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.341071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.341291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.341390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.341618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.341709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.341980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.342192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.342292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.342527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.342627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.342858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.342956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.343180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.343280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.343501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.343591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.343822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.343914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.344170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.344279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.344491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.344601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.344807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.344898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.345127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.345226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.345445 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.345538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.345782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.345881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.346113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.346222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.346440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.346573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.346757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.346866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.347078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.347169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.347395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.347486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.347714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.347856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.348027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.348146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.348365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.348465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.348679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.348781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.349016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.349113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.349330 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.349421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.349649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.349777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.349969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.350061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.350283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.350386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.350598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.350689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.350908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.350998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.351253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.351391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.351537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.351630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.351854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.351945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.352210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.352326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.352534 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.352625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.352858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.352948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.353184 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.353289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.353508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.353597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.353830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.353927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.354149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.354249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.354528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.354692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.355027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.355119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.355346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.355514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.355686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.355816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.356020 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.356170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.356378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.356478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.356702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.357026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.357115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.357360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.357466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.357673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.357764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.357986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.358086 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.358303 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.358406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.358616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.358713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.358924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.359026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.359240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.359349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.359554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.359644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.359864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.359956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.360203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.360298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.360519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.360620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.360863 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.361059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.361201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.361416 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.361545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.361737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.361873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.362071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.362199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.362402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.362525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.362733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.362852 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.363048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.363217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.363380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.363539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.363695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.363855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.364007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.364203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.364355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.364528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.364674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.364851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.364985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.365171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.365296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.365489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.365612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.365812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.365912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.366133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.366231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.366453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.366544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.366770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.366863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.367094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.367184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.367425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.367523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.367734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.367835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.368044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.368169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.368489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.368695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.368793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.369005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.369103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.369316 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.369417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.369626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.369860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.369986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.370242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.370386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.370660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.370872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.371008 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.371237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.371424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.371578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.371680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.371907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.372006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.372242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.372343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.372581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.372674 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.372892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.372982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.373202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.373292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.373519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.373610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.373835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.373924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.374145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.374233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.374468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.374567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.374784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.374921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.375097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.375199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.375423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.375524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.375740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.375968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.376312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.376426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.376664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.376755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.376992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.377081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.377336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.377478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.381926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.382848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.383474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.383565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.383649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.383739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.383822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.383918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384579 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.384939 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.385012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.385081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.385205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.385314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.385436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.385553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.385669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.386373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.386529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.386649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.386740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.386836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.386927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.387921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388601 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.388941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.389033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.389146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.389238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.389464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.389566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.389794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.389900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.390125 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.390218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.390443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.390547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.390767 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.390875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.391080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.391176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.391421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.391522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.391768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.391978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.392125 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.392355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.392468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.392691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.392797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.393038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.393150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.393360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.393546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.393677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.393794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.393989 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.394078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.394303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.394407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.394613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.394713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.394921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.395012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.395235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.395380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.395543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.395636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.395854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.395954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.396186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.396280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.396497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.396598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.396811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.396962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.397121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.397264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.397411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.397499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.397719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.397860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.398015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.398162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.398324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.398418 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.398608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.398748 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.398920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.399064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.399212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.399360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.399514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.399671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.399827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.399981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.400121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.400337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.400441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.400667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.400810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.400996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.401095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.401991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.402100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.402342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.402569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.402660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.402975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.403192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.403353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.403502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.403651 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.403798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.403938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.404200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.404310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.404404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.404546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.404638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.404886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.405034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.405206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.405363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.405526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.405692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.405843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.406027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.406160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.406378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.406479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.406713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.406805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.407046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.407140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.407367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.407461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.407697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.407796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.408024 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.408160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.408371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.408471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.408698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.408806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.409019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.409120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.409336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.409428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.409669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.409773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.409981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.410079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.410294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.410392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.410606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.410708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.410923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.411023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.411236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.411325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.411549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.411650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.411860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.411950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.412199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.412331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.415691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.415840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.415956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.416912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.417234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.417360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.417471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.417657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.417868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.417980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418409 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418533 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.418962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 07:54:31.419392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.419887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.420245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.420569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.420905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.421237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.421564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.421884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.422228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.422549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.422871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.423195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.423516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.423837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.424180 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.424521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.424857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.425176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.425513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.425840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.426172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.426500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.426822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.427162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.427482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.427803 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.428153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.428479 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.428800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.429125 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.429441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.429761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.430086 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.430410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.430751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.431089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.431407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.431744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.432113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.432460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.432871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.433503 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.433867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.434182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.434508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.434827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 07:54:31.435080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 07:54:31.479207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO dbcounter [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Registered counter for database nova_api Sep 07 07:54:31.499372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Registered counter for database nova_api Sep 07 07:54:31.499823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.509634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:31.521149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.528641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:31.567547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.context [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b28c4aa-1c51-47f0-9ca4-409ec11b013c(cell1) {{(pid=120494) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 07:54:31.571593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:54:31.572072 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:54:31.574305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:54:31.575036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:54:31.575487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:54:31.577566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:54:31.579514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO dbcounter [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Registered counter for database nova_cell0 Sep 07 07:54:31.583529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO dbcounter [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Registered counter for database nova_cell1 Sep 07 07:54:31.586122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.context [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b28c4aa-1c51-47f0-9ca4-409ec11b013c(cell1) {{(pid=120495) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 07:54:31.590606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:54:31.591105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:54:31.592481 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.592768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:54:31.593528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:54:31.593992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:54:31.594164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.596049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:54:31.598151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Registered counter for database nova_cell0 Sep 07 07:54:31.600992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:31.602907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Registered counter for database nova_cell1 Sep 07 07:54:31.607432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:31.610850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.612580 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.617679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:31.754283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO dbcounter [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Registered counter for database nova_cell0 Sep 07 07:54:31.761532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_db.sqlalchemy.engines [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.766070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writer thread running {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:31.766220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:31.778174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Registered counter for database nova_cell0 Sep 07 07:54:31.784742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 07:54:31.789154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 07:54:32.085418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:54:32.092795 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:54:32.118719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:54:32.127131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:54:32.439751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:54:32.446023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: WARNING keystonemiddleware.auth_token [None req-c93a5ed2-de18-4848-bee2-e023e80bc708 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:54:32.452173 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aad51af9c0 pid: 120494 (default app) Sep 07 07:54:32.480310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 07:54:32.486692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-2d996b88-66f9-483b-b756-c795d1c28e8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 07:54:32.492015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aad51af9c0 pid: 120495 (default app) Sep 07 07:55:07.584517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:07.585483 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:07.586669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:07.587873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:08.216703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:08.217505 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:08.218356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:08.219314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:08.654507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4773e3bb-b60a-4dd9-b83d-b8005e7890c4 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Action: 'create', calling method: .version_select at 0x7f831fa713a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-27548940", "metadata": {"Type": "work"}}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4773e3bb-b60a-4dd9-b83d-b8005e7890c4 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Request method failure captured: Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 120 Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5bPgEdSX8kEK6LzHwMoSSzBcFLNfpzOgv6oy37QzGV0GiQifebz2-jC87lovvVhBy_e8mRivLb8XjDQbQfURqodwpBaLKkeNwn7Zeq9HD-qrmCwfBnR--y8FZVePuR0Dxf5zmM6B8sSw6XojOVta_se7xfUbaFI2HFae45ar7906Y Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:55:08.660532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94ef8ab5782f4d4cb8ceb6d8b78911ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 04e229ddb87d4e6eaff2fd433ec2606c Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-27548940", "metadata": {"Type": "work"}}} Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 07:55:08.661901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-27548940', 'metadata': {'Type': 'work'}}}} Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:55:08.662745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 07:55:08.664152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 07:55:08.665351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 07:55:08.665351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.665351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4773e3bb-b60a-4dd9-b83d-b8005e7890c4 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:55:08.665351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4773e3bb-b60a-4dd9-b83d-b8005e7890c4 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.087546 Sep 07 07:55:08.665351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 7 07:55:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1090 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 07:55:08.672910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa014dd8-4f80-4737-95f2-107cdc7e7af9 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Action: 'create', calling method: .version_select at 0x7f831fa71ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1642178192", "metadata": {"Type": "work"}}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa014dd8-4f80-4737-95f2-107cdc7e7af9 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Request method failure captured: Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 120 Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5bPgEdSX8kEK6LzHwMoSSzBcFLNfpzOgv6oy37QzGV0GiQifebz2-jC87lovvVhBy_e8mRivLb8XjDQbQfURqodwpBaLKkeNwn7Zeq9HD-qrmCwfBnR--y8FZVePuR0Dxf5zmM6B8sSw6XojOVta_se7xfUbaFI2HFae45ar7906Y Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:55:08.676674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94ef8ab5782f4d4cb8ceb6d8b78911ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 04e229ddb87d4e6eaff2fd433ec2606c Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1642178192", "metadata": {"Type": "work"}}} Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 07:55:08.677988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1642178192', 'metadata': {'Type': 'work'}}}} Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi '0' Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:55:08.678785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 07:55:08.680140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 07:55:08.683031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 07:55:08.683031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.683031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa014dd8-4f80-4737-95f2-107cdc7e7af9 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:55:08.683031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa014dd8-4f80-4737-95f2-107cdc7e7af9 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008917 Sep 07 07:55:08.683031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 7 07:55:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 07:55:08.689729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c691cc4-d4e9-4e15-9ce3-c4d27f4466b5 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Action: 'create', calling method: .version_select at 0x7f831f92b0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1596463943", "metadata": {"Type": "work"}}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c691cc4-d4e9-4e15-9ce3-c4d27f4466b5 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Request method failure captured: Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 119 Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5bPgEdSX8kEK6LzHwMoSSzBcFLNfpzOgv6oy37QzGV0GiQifebz2-jC87lovvVhBy_e8mRivLb8XjDQbQfURqodwpBaLKkeNwn7Zeq9HD-qrmCwfBnR--y8FZVePuR0Dxf5zmM6B8sSw6XojOVta_se7xfUbaFI2HFae45ar7906Y Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:55:08.693018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94ef8ab5782f4d4cb8ceb6d8b78911ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 04e229ddb87d4e6eaff2fd433ec2606c Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1596463943", "metadata": {"Type": "work"}}} Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 07:55:08.695647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1596463943', 'metadata': {'Type': 'work'}}}} Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise error Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi '' Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:55:08.698424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 07:55:08.701319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 07:55:08.704180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 07:55:08.704180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:08.704180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c691cc4-d4e9-4e15-9ce3-c4d27f4466b5 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:55:08.704180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c691cc4-d4e9-4e15-9ce3-c4d27f4466b5 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009385 Sep 07 07:55:08.704180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 3/3] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 7 07:55:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 07:55:08.710418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f865cdf-b255-49c1-8919-e9c68138e3e0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Calling method '.version_select at 0x7f831f92baf0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:09.534156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2ea935f5-05d3-4bbe-9cd8-8ac5cfc7131d tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Action: 'create', calling method: .version_select at 0x7f831fa703a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1647233119", "metadata": {"Type": "work"}}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:09.822101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-7f865cdf-b255-49c1-8919-e9c68138e3e0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] HTTP exception thrown: Volume tempest-invalid-657387057 could not be found. Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f865cdf-b255-49c1-8919-e9c68138e3e0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Request method failure captured: Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-657387057 HTTP/1.1 Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5bPgEdSX8kEK6LzHwMoSSzBcFLNfpzOgv6oy37QzGV0GiQifebz2-jC87lovvVhBy_e8mRivLb8XjDQbQfURqodwpBaLKkeNwn7Zeq9HD-qrmCwfBnR--y8FZVePuR0Dxf5zmM6B8sSw6XojOVta_se7xfUbaFI2HFae45ar7906Y Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:55:09.826770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94ef8ab5782f4d4cb8ceb6d8b78911ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 04e229ddb87d4e6eaff2fd433ec2606c Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Volume tempest-invalid-657387057 could not be found. Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'tempest-invalid-657387057'} Sep 07 07:55:09.828279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-657387057 could not be found. (HTTP 404) (Request-ID: req-d7e3b0db-49f8-40ca-9510-17d5a18c1c2d) Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:09.829275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 07:55:09.830780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-657387057 could not be found. Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:55:09.833017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-657387057 could not be found. Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-657387057 could not be found. Sep 07 07:55:09.836898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:09.841831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f865cdf-b255-49c1-8919-e9c68138e3e0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Returning 404 to user: Volume tempest-invalid-657387057 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:55:09.843013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f865cdf-b255-49c1-8919-e9c68138e3e0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-657387057" status: 404 len: 98 microversion: 2.1 time: 1.140049 Sep 07 07:55:09.844134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 4/4] 10.222.0.26 () {58 vars in 1215 bytes} [Wed Sep 7 07:55:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-657387057 => generated 98 bytes in 1143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 07:55:09.858444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60e0f011-294b-4ecd-bde0-54bc3170f283 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008423 Sep 07 07:55:09.859192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 5/5] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Sep 7 07:55:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 07 07:55:09.875144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3eb89e1-65a3-4d3d-9adb-244f8d6519a9 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009570 Sep 07 07:55:09.886790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 6/6] 10.222.0.26 () {58 vars in 1137 bytes} [Wed Sep 7 07:55:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 07:55:09.904435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46a09b0c-3dc6-4087-81a4-2c93a2464a24 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Calling method '.version_select at 0x7f831f8b2dc0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:10.091651 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-46a09b0c-3dc6-4087-81a4-2c93a2464a24 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] HTTP exception thrown: Volume a25346ab-2866-4148-908b-7ea0d1a5372f could not be found. Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46a09b0c-3dc6-4087-81a4-2c93a2464a24 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Request method failure captured: Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: DELETE /compute/v2.1/os-volumes/a25346ab-2866-4148-908b-7ea0d1a5372f HTTP/1.1 Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5bPgEdSX8kEK6LzHwMoSSzBcFLNfpzOgv6oy37QzGV0GiQifebz2-jC87lovvVhBy_e8mRivLb8XjDQbQfURqodwpBaLKkeNwn7Zeq9HD-qrmCwfBnR--y8FZVePuR0Dxf5zmM6B8sSw6XojOVta_se7xfUbaFI2HFae45ar7906Y Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:55:10.093721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94ef8ab5782f4d4cb8ceb6d8b78911ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 04e229ddb87d4e6eaff2fd433ec2606c Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Volume a25346ab-2866-4148-908b-7ea0d1a5372f could not be found. Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'a25346ab-2866-4148-908b-7ea0d1a5372f'} Sep 07 07:55:10.095000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a25346ab-2866-4148-908b-7ea0d1a5372f could not be found. (HTTP 404) (Request-ID: req-1b970134-1db4-42c2-a46e-7233b46faf37) Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:10.095762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 07:55:10.096847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a25346ab-2866-4148-908b-7ea0d1a5372f could not be found. Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 07:55:10.098781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a25346ab-2866-4148-908b-7ea0d1a5372f could not be found. Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a25346ab-2866-4148-908b-7ea0d1a5372f could not be found. Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46a09b0c-3dc6-4087-81a4-2c93a2464a24 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Returning 404 to user: Volume a25346ab-2866-4148-908b-7ea0d1a5372f could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:55:10.100054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46a09b0c-3dc6-4087-81a4-2c93a2464a24 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/a25346ab-2866-4148-908b-7ea0d1a5372f" status: 404 len: 109 microversion: 2.1 time: 0.205014 Sep 07 07:55:10.102785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 7/7] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 07:55:09 2022] DELETE /compute/v2.1/os-volumes/a25346ab-2866-4148-908b-7ea0d1a5372f => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 07:55:10.116776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f42ea896-b0f0-4c74-bbb1-5af59ebb9ec0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Calling method '.version_select at 0x7f831f85e550>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:10.340620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-f42ea896-b0f0-4c74-bbb1-5af59ebb9ec0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] HTTP exception thrown: Volume 3af72dec-c575-408a-aacb-d555fc1d2057 could not be found. Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f42ea896-b0f0-4c74-bbb1-5af59ebb9ec0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Request method failure captured: Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/os-volumes/3af72dec-c575-408a-aacb-d555fc1d2057 HTTP/1.1 Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5bPgEdSX8kEK6LzHwMoSSzBcFLNfpzOgv6oy37QzGV0GiQifebz2-jC87lovvVhBy_e8mRivLb8XjDQbQfURqodwpBaLKkeNwn7Zeq9HD-qrmCwfBnR--y8FZVePuR0Dxf5zmM6B8sSw6XojOVta_se7xfUbaFI2HFae45ar7906Y Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:55:10.345961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_94ef8ab5782f4d4cb8ceb6d8b78911ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/94ef8ab5782f4d4cb8ceb6d8b78911ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 94ef8ab5782f4d4cb8ceb6d8b78911ba Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesNegativeTest-1579743931 Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 04e229ddb87d4e6eaff2fd433ec2606c Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesNegativeTest-1579743931-project Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Volume 3af72dec-c575-408a-aacb-d555fc1d2057 could not be found. Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '3af72dec-c575-408a-aacb-d555fc1d2057'} Sep 07 07:55:10.347370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3af72dec-c575-408a-aacb-d555fc1d2057 could not be found. (HTTP 404) (Request-ID: req-efa899c5-82f4-4b7f-8326-f286902997ea) Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:10.348658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 07:55:10.349767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3af72dec-c575-408a-aacb-d555fc1d2057 could not be found. Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 07:55:10.353746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3af72dec-c575-408a-aacb-d555fc1d2057 could not be found. Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3af72dec-c575-408a-aacb-d555fc1d2057 could not be found. Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f42ea896-b0f0-4c74-bbb1-5af59ebb9ec0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] Returning 404 to user: Volume 3af72dec-c575-408a-aacb-d555fc1d2057 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:55:10.355082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f42ea896-b0f0-4c74-bbb1-5af59ebb9ec0 tempest-VolumesNegativeTest-1579743931 tempest-VolumesNegativeTest-1579743931-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3af72dec-c575-408a-aacb-d555fc1d2057" status: 404 len: 109 microversion: 2.1 time: 0.243913 Sep 07 07:55:10.361385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 8/8] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:10 2022] GET /compute/v2.1/os-volumes/3af72dec-c575-408a-aacb-d555fc1d2057 => generated 109 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 07:55:11.412518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce83b692-9060-47ed-a57f-75563974570e tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f8b2b80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:11.438969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2ea935f5-05d3-4bbe-9cd8-8ac5cfc7131d tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.233085 Sep 07 07:55:11.440166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 1/9] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 7 07:55:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3236 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 07:55:11.459833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0d1e418e-a45a-410d-ad95-39fa187ff523 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Calling method '.version_select at 0x7f831f952280>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:11.508421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce83b692-9060-47ed-a57f-75563974570e tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bf56ccef-b822-4bed-954f-522458169efd" status: 200 len: 350 microversion: 2.1 time: 0.099564 Sep 07 07:55:11.509904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 9/10] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:11 2022] GET /compute/v2.1/os-volumes/bf56ccef-b822-4bed-954f-522458169efd => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:11.556002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0d1e418e-a45a-410d-ad95-39fa187ff523 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a" status: 200 len: 353 microversion: 2.1 time: 0.100296 Sep 07 07:55:11.556862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 2/11] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:11 2022] GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:55:12.572956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c21f475-890f-4445-8c7d-21f431c2248d tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Calling method '.version_select at 0x7f831f85e430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:12.707682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c21f475-890f-4445-8c7d-21f431c2248d tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a" status: 200 len: 354 microversion: 2.1 time: 0.140545 Sep 07 07:55:12.708582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 10/12] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:12 2022] GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:12.737777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1a45979c-2126-4002-94aa-976030b129f8 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Calling method '.version_select at 0x7f831f9529d0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:12.839389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1a45979c-2126-4002-94aa-976030b129f8 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a" status: 200 len: 354 microversion: 2.1 time: 0.116607 Sep 07 07:55:12.840270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 3/13] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:12 2022] GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:12.861699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0aa88d2-a03f-4dae-9970-c6bc7985dea4 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Calling method '.version_select at 0x7f831f86d0d0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:13.138564 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0aa88d2-a03f-4dae-9970-c6bc7985dea4 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a" status: 202 len: 0 microversion: 2.1 time: 0.280611 Sep 07 07:55:13.139619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 11/14] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 07:55:12 2022] DELETE /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:55:13.148038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4b256c2a-d637-4331-991e-98f7172ba65f tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Calling method '.version_select at 0x7f831f8dd0d0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:13.222423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4b256c2a-d637-4331-991e-98f7172ba65f tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a" status: 200 len: 353 microversion: 2.1 time: 0.078161 Sep 07 07:55:13.223475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 4/15] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:13 2022] GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:13.292263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1da66ca-3f31-4490-8e95-9300c799f477 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f85e5e0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:13.380254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1da66ca-3f31-4490-8e95-9300c799f477 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/20986d0f-3538-4f54-9780-034122e296c5" status: 200 len: 350 microversion: 2.1 time: 0.093537 Sep 07 07:55:13.381774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 12/16] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:13 2022] GET /compute/v2.1/os-volumes/20986d0f-3538-4f54-9780-034122e296c5 => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:14.238965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-23a5ebbe-54b2-4c83-b9be-26141fb2e3b3 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Calling method '.version_select at 0x7f831f952d30>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:14.299288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-23a5ebbe-54b2-4c83-b9be-26141fb2e3b3 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] HTTP exception thrown: Volume 148b56b9-aa52-4cb9-97f2-f77e802fc12a could not be found. Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-23a5ebbe-54b2-4c83-b9be-26141fb2e3b3 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Request method failure captured: Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a HTTP/1.1 Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5cWVPgmeC1CzZkJuoPuQ_8VkgMYxdQRlZAHkNGiIhEOEHDNn_hFE_9-vDf5s7PCVGSn4d2UcYcYwIgcbeeXcGyaRZ2wuYaUwZGYM_WFFh3NzwST-mWsf1TryaC4HsS6Xcs64OacGdtobQ5tJYzNKQWTpg9BlLdozOweo-kStyq3IY Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 688ecc61e9634e738cd742384173461b Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesGetTestJSON-101986234 Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 07:55:14.305938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/688ecc61e9634e738cd742384173461b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_688ecc61e9634e738cd742384173461b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/688ecc61e9634e738cd742384173461b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/688ecc61e9634e738cd742384173461b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesGetTestJSON-101986234 Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 688ecc61e9634e738cd742384173461b Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesGetTestJSON-101986234 Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesGetTestJSON-101986234-project Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 7a50189fafdc4303893654b48cf6ba4b Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesGetTestJSON-101986234-project Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Volume 148b56b9-aa52-4cb9-97f2-f77e802fc12a could not be found. Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '148b56b9-aa52-4cb9-97f2-f77e802fc12a'} Sep 07 07:55:14.307711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 148b56b9-aa52-4cb9-97f2-f77e802fc12a could not be found. (HTTP 404) (Request-ID: req-b3016f87-96b0-4d55-a725-fd798442a672) Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:14.308343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 07:55:14.309181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 148b56b9-aa52-4cb9-97f2-f77e802fc12a could not be found. Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 07:55:14.310011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 148b56b9-aa52-4cb9-97f2-f77e802fc12a could not be found. Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 148b56b9-aa52-4cb9-97f2-f77e802fc12a could not be found. Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-23a5ebbe-54b2-4c83-b9be-26141fb2e3b3 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] Returning 404 to user: Volume 148b56b9-aa52-4cb9-97f2-f77e802fc12a could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-23a5ebbe-54b2-4c83-b9be-26141fb2e3b3 tempest-VolumesGetTestJSON-101986234 tempest-VolumesGetTestJSON-101986234-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a" status: 404 len: 109 microversion: 2.1 time: 0.074260 Sep 07 07:55:14.310819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 5/17] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:14 2022] GET /compute/v2.1/os-volumes/148b56b9-aa52-4cb9-97f2-f77e802fc12a => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 07:55:15.141369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6a5746e1-2658-4bea-8bc8-489840fe87ae tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f8b2a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:15.256049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6a5746e1-2658-4bea-8bc8-489840fe87ae tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c0bfd29f-3fc1-4002-8368-763dbe7f45b1" status: 200 len: 351 microversion: 2.1 time: 0.119349 Sep 07 07:55:15.267427 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 13/18] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 07:55:15 2022] GET /compute/v2.1/os-volumes/c0bfd29f-3fc1-4002-8368-763dbe7f45b1 => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:15.271943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0e92afb4-8a48-4288-87e9-ec297ee6e173 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f832029f8b0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:15.465595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0e92afb4-8a48-4288-87e9-ec297ee6e173 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.198277 Sep 07 07:55:15.466536 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 6/19] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Sep 7 07:55:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:15.482984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52e080ee-e215-45c7-907d-977d659fc6ef tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f8b2700>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:15.691161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52e080ee-e215-45c7-907d-977d659fc6ef tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.212933 Sep 07 07:55:15.692108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 14/20] 10.222.0.26 () {58 vars in 1149 bytes} [Wed Sep 7 07:55:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:15.707805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-94bad5de-71ad-4b3e-8a2a-4a7ce5551ec5 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f955670>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:15.925009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-94bad5de-71ad-4b3e-8a2a-4a7ce5551ec5 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.220405 Sep 07 07:55:15.926196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 7/21] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Sep 7 07:55:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:15.939952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4717870f-17bd-49eb-bb17-2610764e3189 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f8b2a60>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:16.201433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4717870f-17bd-49eb-bb17-2610764e3189 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.265603 Sep 07 07:55:16.202436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 15/22] 10.222.0.26 () {58 vars in 1167 bytes} [Wed Sep 7 07:55:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:16.215891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a18fc1dc-5ac4-418d-b12a-a3373902ac07 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f8c19d0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:16.436393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a18fc1dc-5ac4-418d-b12a-a3373902ac07 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.224527 Sep 07 07:55:16.438193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 8/23] 10.222.0.26 () {58 vars in 1170 bytes} [Wed Sep 7 07:55:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:16.453631 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fcd98694-4f4f-4d1d-b1b1-d57ee5bbe41e tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f86daf0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:16.685927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fcd98694-4f4f-4d1d-b1b1-d57ee5bbe41e tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.237337 Sep 07 07:55:16.687011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 16/24] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Sep 7 07:55:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:16.701229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d0918f06-670b-4d8e-ba20-88f51f6ea94b tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f8c18b0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:16.940744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d0918f06-670b-4d8e-ba20-88f51f6ea94b tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.243414 Sep 07 07:55:16.941625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 9/25] 10.222.0.26 () {58 vars in 1188 bytes} [Wed Sep 7 07:55:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:16.959507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e721461c-26d4-48f7-9869-20c6525177a1 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] Calling method '.version_select at 0x7f831f86d4c0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:17.208174 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e721461c-26d4-48f7-9869-20c6525177a1 tempest-VolumesTestJSON-1569130199 tempest-VolumesTestJSON-1569130199-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.254714 Sep 07 07:55:17.218264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 17/26] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Sep 7 07:55:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:23.322830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1126262941", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "networks": [{"uuid": "e09adae8-406d-4c3f-89e0-7fce9bbc3a71"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:23.557471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] validate_networks() for [('e09adae8-406d-4c3f-89e0-7fce9bbc3a71', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:55:26.302492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1004793815", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:26.638516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] validate_networks() for [('811e9a20-36aa-4e45-b990-9e2b0dd7f3c3', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:55:27.392513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:55:27.393162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:55:27.394447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:55:27.394873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:55:27.395287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:55:27.441210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:27.444198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:27.447835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:27.449731 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:27.452545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:27.452992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:27.652546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Getting quotas for project b093ac8c5cbc4bb6be326b2fb993a76b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:55:27.670001 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Getting quotas for user 4035909c0f414e5ca7fbab2caee29f4d and project b093ac8c5cbc4bb6be326b2fb993a76b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:55:27.723480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:55:27.739091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:55:27.924036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-265495b8-070d-445e-9619-63b8d328e8c9 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.890659 Sep 07 07:55:27.927518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 10/27] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:55:28.545866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ef4c6723-2765-4115-8778-2b7f4aba6809 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: .version_select at 0x7f831ef57040>, body: {"keypair": {"name": "tempest-keypair-136022875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUTwmYR6Kjht7MB7fA4v7/sFZQsCBt0XHgGdOKpOeRy4xdzZT4qPUPNUqda+OctbUqhxpdeI3G3Wz/nO312fvZ+eoGv6P7P2o/HAq3Wfg1/v7gN8NQZys8GaWesujT2tw=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:28.617783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-ef4c6723-2765-4115-8778-2b7f4aba6809 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:55:28.623849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-ef4c6723-2765-4115-8778-2b7f4aba6809 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:55:28.709994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ef4c6723-2765-4115-8778-2b7f4aba6809 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.778993 Sep 07 07:55:28.711016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 11/28] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 07:55:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:28.720898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-213a5bbf-0f63-48b2-9559-38ad4f410922 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:28.721528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-213a5bbf-0f63-48b2-9559-38ad4f410922 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:29.079516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-213a5bbf-0f63-48b2-9559-38ad4f410922 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:29.118644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-213a5bbf-0f63-48b2-9559-38ad4f410922 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1215 microversion: 2.1 time: 0.403640 Sep 07 07:55:29.150630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 12/29] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:28 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1215 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:29.497676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f76c9294-428f-4114-98d1-888a6a16c0b6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'create', calling method: .version_select at 0x7f831ef59d30>, body: {"keypair": {"name": "tempest-keypair-1795564661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl+txksH7OsDJgrGUp2oQyPqHmsDQQV3Y3vEzneSXbCXYdcf9Q6yO+h0xHJTXBp/6Tzy0ndS2QzrC5rvZJZnLFBTHkz9BVLKIR8y00hD4LOwoSDEfSXYmHlFIGaX6qaog=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:29.586062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-f76c9294-428f-4114-98d1-888a6a16c0b6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:55:29.608597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-f76c9294-428f-4114-98d1-888a6a16c0b6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for user 457d69a7306d46cd8445f887eb95c517 and project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:55:29.702811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f76c9294-428f-4114-98d1-888a6a16c0b6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.550662 Sep 07 07:55:29.713977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 13/30] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Sep 7 07:55:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 562 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 07:55:30.060719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:55:30.061949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:55:30.062742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:55:30.063370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:55:30.064742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:55:30.121788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:30.122281 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:30.132403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:30.134743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:30.135251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:30.135694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:30.161882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ea6853e2-aba4-4cd8-b51c-202a5ae59c3d tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:30.162985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ea6853e2-aba4-4cd8-b51c-202a5ae59c3d tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:30.279691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:55:30.287873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for user b52ececfc19b41b5b8387dc6908d4a4a and project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:55:30.304350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:55:30.319928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:55:30.530512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e413fe94-ffa9-497b-9b87-f711fbf36977 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.958371 Sep 07 07:55:30.530912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ea6853e2-aba4-4cd8-b51c-202a5ae59c3d tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:30.542700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 18/31] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:55:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 4984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:55:30.544232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ea6853e2-aba4-4cd8-b51c-202a5ae59c3d tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1215 microversion: 2.1 time: 0.388957 Sep 07 07:55:30.561379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35cb246d-3cda-4aea-8f25-663fd7f98b29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:30.562629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35cb246d-3cda-4aea-8f25-663fd7f98b29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:30.564055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 14/32] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:30 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1215 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:30.917821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-35cb246d-3cda-4aea-8f25-663fd7f98b29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:31.005820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35cb246d-3cda-4aea-8f25-663fd7f98b29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1222 microversion: 2.1 time: 0.457488 Sep 07 07:55:31.011202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 19/33] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:30 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1222 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:31.472470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-164847546", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:31.573369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:31.574050 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:31.611046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:31.612691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] validate_networks() for [('811e9a20-36aa-4e45-b990-9e2b0dd7f3c3', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:55:31.616117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:31.622431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:31.626141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:31.628345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:31.635179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:32.273926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:32.326330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-64a758b8-1cab-49f1-a131-347fd632ceb1 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1267 microversion: 2.1 time: 0.757807 Sep 07 07:55:32.349622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 20/34] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:31 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1267 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:33.359183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:33.360002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:33.387690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:33.390150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:33.393067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:33.396662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:33.397474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:33.398577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:33.683403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:33.707914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-246b6520-3d5b-4202-9927-9818590f3ee2 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1273 microversion: 2.1 time: 0.352217 Sep 07 07:55:33.729972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 21/35] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:33 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:34.003909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:55:34.004502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:55:34.004861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:55:34.005453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:55:34.006021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:55:34.022196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:34.022870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:34.023475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:34.025290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:34.028715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:34.030350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:34.090885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:55:34.105144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for user b52ececfc19b41b5b8387dc6908d4a4a and project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:55:34.149876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:55:34.152046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:55:34.215156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-212a46f5-db69-46b7-8958-5de9889a4436 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.764930 Sep 07 07:55:34.216662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 15/36] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:55:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:55:34.244284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b6b98da-0a78-4b56-96ee-a1226834638c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:34.251886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9b6b98da-0a78-4b56-96ee-a1226834638c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:34.611284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b6b98da-0a78-4b56-96ee-a1226834638c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:34.626095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b6b98da-0a78-4b56-96ee-a1226834638c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1221 microversion: 2.1 time: 0.401369 Sep 07 07:55:34.627200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 22/37] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:34 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1221 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:34.740874 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:34.741516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:34.762557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:34.763063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:34.765582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:34.771782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:34.774858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:34.776720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:35.595838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:35.609972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6a175648-54e8-4131-bce8-e2b1c9522c0b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1273 microversion: 2.1 time: 0.880003 Sep 07 07:55:35.610751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 16/38] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:34 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1273 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:35.654475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:35.655077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:35.665153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:35.666301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:35.666932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:35.667879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:35.668708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:35.669292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:35.762076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:35.781625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f05cefd7-590a-4b8e-879a-5a4e581defa8 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1225 microversion: 2.1 time: 0.131335 Sep 07 07:55:35.784374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 23/39] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:35 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:36.635506 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:36.646330 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:36.657127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:36.657891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:36.660864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:36.662164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:36.662815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:36.665161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:36.811725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:36.812429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:36.823442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:36.827863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:36.829054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:36.830230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:36.835400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:36.836151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:37.069010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:37.096306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4d9a51ac-88c7-472c-bc30-767135bd686c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1225 microversion: 2.1 time: 0.287920 Sep 07 07:55:37.097753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 24/40] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:36 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1225 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:37.538527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:37.557593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2226df97-22aa-4f98-8a7a-7565728d431f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.926821 Sep 07 07:55:37.572061 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1175973227", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d7d7a39-e6a6-423e-b552-9ec48c064b08"}], "security_groups": [{"name": "tempest-securitygroup--1414147517"}], "key_name": "tempest-keypair-136022875", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:37.587131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 17/41] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:36 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:38.017357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] validate_networks() for [('3d7d7a39-e6a6-423e-b552-9ec48c064b08', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:55:38.127636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:38.132277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:38.139331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:38.145634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:38.148678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:38.156565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:38.157417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:38.165427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:38.499638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:38.521705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7742893a-9c2e-4af6-aad7-37ea549e29a9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1273 microversion: 2.1 time: 0.397224 Sep 07 07:55:38.522964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 18/42] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:38 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:38.587881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:38.588913 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:38.600412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:38.603860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:38.604575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:38.632118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:38.632752 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:38.633253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:39.782653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:55:39.783406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:55:39.783817 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:55:39.784354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:55:39.785197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:55:39.803547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:39.808840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:39.812673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:39.817287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:39.818543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:39.819222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:39.920974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:55:39.936261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:55:39.968730 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:55:39.975175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:55:40.134042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6baaba34-7d88-4fee-9d85-bda10d8439fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.578000 Sep 07 07:55:40.137699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 25/43] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:55:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 07:55:40.171582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1010559343", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1b8879d-7ef7-414a-a6c3-f77fea09d2f8"}], "security_groups": [{"name": "tempest-securitygroup--553615837"}], "key_name": "tempest-keypair-1795564661", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:41.058426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] validate_networks() for [('c1b8879d-7ef7-414a-a6c3-f77fea09d2f8', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:55:42.145329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:42.163587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-240c0bd3-f394-4ef8-9bb3-44f2278c7f8a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 3.580719 Sep 07 07:55:42.166948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 19/44] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:38 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 3586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:42.172991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:42.182991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:42.224309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:42.228380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:42.228976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:42.230241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:42.232882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:42.233340 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:42.397962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:42.410129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8ae04a59-c6b5-464c-910e-5788b45c1ff6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1279 microversion: 2.1 time: 0.240775 Sep 07 07:55:42.410770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 20/45] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:42 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:42.425243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:42.426287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:42.448941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:42.449797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:42.450796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:42.453911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:42.467911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:42.472932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:42.626900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:42.640033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-904d0af1-cc17-4535-bffa-1188f7d3d44d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1293 microversion: 2.1 time: 0.222974 Sep 07 07:55:42.641002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 21/46] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:42 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1293 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:42.942351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:55:42.943433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:55:42.944135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:55:42.944758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:55:42.945369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:55:42.978100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:42.980923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:42.981448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:42.982300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:42.989029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:42.990634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:43.044474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:55:43.057167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for user 457d69a7306d46cd8445f887eb95c517 and project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:55:43.090452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:55:43.092938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:55:43.202447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:43.204775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:43.220203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:43.222435 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:43.225338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:43.227702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:43.229315 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:43.231239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:43.235322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2f2a22a-384d-4b9c-95dc-c352dd6eb3bf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.095770 Sep 07 07:55:43.238860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 26/47] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Sep 7 07:55:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 3100 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 07:55:43.255372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1514113-3e0e-4325-9ff6-56a0b827365e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:43.261489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1514113-3e0e-4325-9ff6-56a0b827365e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:43.674720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1514113-3e0e-4325-9ff6-56a0b827365e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:43.712825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1514113-3e0e-4325-9ff6-56a0b827365e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:43.714738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1514113-3e0e-4325-9ff6-56a0b827365e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:43.720204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1514113-3e0e-4325-9ff6-56a0b827365e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1282 microversion: 2.20 time: 0.472669 Sep 07 07:55:43.745336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 27/48] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:43 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1282 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:43.770456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:43.772724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:43.793510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:43.800850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:43.806470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:43.807476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:43.808255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:43.808844 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:44.058620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:44.112934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=24 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:44.645476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:44.669478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6679f0cd-af48-458d-9b6a-91fc15dd937b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 1.481339 Sep 07 07:55:44.670714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 22/49] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:43 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:45.003705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:45.041387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ef24db0-9c3c-4300-91c7-626857d85c66 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 1.280226 Sep 07 07:55:45.044531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 28/50] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:43 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:45.065286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:45.066000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:45.092263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.095481 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.095975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.099871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.102607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.103955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.297036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-ebdbba79-6240-43db-a85b-f0c62fe74b82 req-74fb2fc6-bc10-47a7-ad97-ba66c704deb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d122d8-2187-49e4-82c7-839909d10854", "tag": "40819e72-6b92-48e6-8907-95585c9cb368"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:45.337956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ebdbba79-6240-43db-a85b-f0c62fe74b82 req-74fb2fc6-bc10-47a7-ad97-ba66c704deb1 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.338476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ebdbba79-6240-43db-a85b-f0c62fe74b82 req-74fb2fc6-bc10-47a7-ad97-ba66c704deb1 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.340057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ebdbba79-6240-43db-a85b-f0c62fe74b82 req-74fb2fc6-bc10-47a7-ad97-ba66c704deb1 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.412556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-ebdbba79-6240-43db-a85b-f0c62fe74b82 req-74fb2fc6-bc10-47a7-ad97-ba66c704deb1 service nova] Creating event network-changed:40819e72-6b92-48e6-8907-95585c9cb368 for instance c7d122d8-2187-49e4-82c7-839909d10854 on hv-cinder-83602 Sep 07 07:55:45.416197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ebdbba79-6240-43db-a85b-f0c62fe74b82 req-74fb2fc6-bc10-47a7-ad97-ba66c704deb1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 07:55:45.416884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ebdbba79-6240-43db-a85b-f0c62fe74b82 req-74fb2fc6-bc10-47a7-ad97-ba66c704deb1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 07:55:45.418827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.420562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.421615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.424258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.425722 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.426521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.441209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.compute.rpcapi [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 07:55:45.444106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=120495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 07:55:45.471513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-62bb2f06-c1e2-4ab3-8d6f-682417c9d2c4 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.798676 Sep 07 07:55:45.473116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 23/51] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:45.488495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:45.490229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:45.503749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.506405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.507170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.509105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.511801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.512887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.581347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:45.647333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cd0f1e2-9e52-4172-b412-284bba8ba3da tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1299 microversion: 2.1 time: 0.598007 Sep 07 07:55:45.650876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 29/52] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:45 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1299 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:45.697294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:45.698596 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:45.736721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.741173 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.742090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.749000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:45.749527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:45.749974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:45.803254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:45.820679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:45.823797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:45.827094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4b766cca-f307-4379-8e02-3e3df43c1228 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1334 microversion: 2.20 time: 0.348970 Sep 07 07:55:45.841515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 24/53] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:45 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1334 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:46.071667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:46.072553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:46.082099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:46.089863 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:46.090384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:46.098017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:46.098539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:46.098992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:46.996262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:47.005407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c29ec198-212b-4141-b7c4-2b0c40642c90 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.939068 Sep 07 07:55:47.006582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 25/54] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:46 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:47.016195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:47.018542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:47.034069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:47.037486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:47.038199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:47.042501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:47.043763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:47.046403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:47.152306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:47.164024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-22ee4e7d-ca23-4a4f-8230-10e26a0082ff tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 1.472430 Sep 07 07:55:47.165711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 30/55] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:45 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:47.172247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:47.173566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:47.182986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:47.183815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:47.184615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:47.185636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:47.186437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:47.187067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:47.281516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:47.290955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9d87e7fa-9908-4598-a92d-cb853d67fd73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1299 microversion: 2.1 time: 0.283107 Sep 07 07:55:47.292039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 26/56] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:47 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1299 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:47.292952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:47.306869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:47.308464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:47.310258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-561e1baf-a8ef-43be-9ace-ab3956ad963e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1340 microversion: 2.20 time: 0.143495 Sep 07 07:55:47.311103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 31/57] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:47 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1340 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:47.528943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-01884910-2dfe-473a-b7e8-7edcdd8306cf req-46ec6c21-9857-49d4-b56a-6a6c09df78e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee87953e-ba27-4c28-b0db-0dfa81b496e6", "tag": "e3286f12-f5f4-4c6b-9125-ae90c9cdaefa"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:47.550513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-01884910-2dfe-473a-b7e8-7edcdd8306cf req-46ec6c21-9857-49d4-b56a-6a6c09df78e3 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:47.551087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-01884910-2dfe-473a-b7e8-7edcdd8306cf req-46ec6c21-9857-49d4-b56a-6a6c09df78e3 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:47.551539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-01884910-2dfe-473a-b7e8-7edcdd8306cf req-46ec6c21-9857-49d4-b56a-6a6c09df78e3 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:47.571483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-01884910-2dfe-473a-b7e8-7edcdd8306cf req-46ec6c21-9857-49d4-b56a-6a6c09df78e3 service nova] Creating event network-changed:e3286f12-f5f4-4c6b-9125-ae90c9cdaefa for instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 on hv-cinder-83602 Sep 07 07:55:47.584054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-01884910-2dfe-473a-b7e8-7edcdd8306cf req-46ec6c21-9857-49d4-b56a-6a6c09df78e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059198 Sep 07 07:55:47.590899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 27/58] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:48.037154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:48.041302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:48.052958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.053446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.054033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.058722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.059212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.059662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.223758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:48.232488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff4d778b-ea1f-47c5-a985-004a4a8ca961 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.202200 Sep 07 07:55:48.233570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 32/59] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:48 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:48.238071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:48.238707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:48.245013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.245732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.246324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.247216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.247460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.248030 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.389682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:48.399026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9e0c743-8898-4f92-ae68-3aff60a968b5 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.163864 Sep 07 07:55:48.399964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 33/60] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:48 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:48.404958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:48.405733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:48.411748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.412421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.419351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.420437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.421251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.422130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.443581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-91631b28-a393-4eab-979b-72fa2d549d48 req-6a73f904-c1a6-4871-ae45-1afaa32253f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e63064-b3e0-4870-b57d-c075177e98ce", "tag": "d2f19dac-b216-473d-b233-7f59237c680e"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:48.455772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-91631b28-a393-4eab-979b-72fa2d549d48 req-6a73f904-c1a6-4871-ae45-1afaa32253f7 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.456498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-91631b28-a393-4eab-979b-72fa2d549d48 req-6a73f904-c1a6-4871-ae45-1afaa32253f7 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.457117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-91631b28-a393-4eab-979b-72fa2d549d48 req-6a73f904-c1a6-4871-ae45-1afaa32253f7 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.471316 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-91631b28-a393-4eab-979b-72fa2d549d48 req-6a73f904-c1a6-4871-ae45-1afaa32253f7 service nova] Creating event network-changed:d2f19dac-b216-473d-b233-7f59237c680e for instance d3e63064-b3e0-4870-b57d-c075177e98ce on hv-cinder-83602 Sep 07 07:55:48.478122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-91631b28-a393-4eab-979b-72fa2d549d48 req-6a73f904-c1a6-4871-ae45-1afaa32253f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300458 Sep 07 07:55:48.479657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 28/61] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:55:48.485825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:48.486776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:48.495707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.496530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.497105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.497958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:48.498650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:48.499333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:48.595717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:48.601130 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:48.606388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc7193aa-cdb5-4e00-86bd-7a3c01edbf9e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.204835 Sep 07 07:55:48.606889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 34/62] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:48 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:48.610794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:48.612774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:48.614313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7293f82a-38d6-4703-bf97-19101d83e6f1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1340 microversion: 2.20 time: 0.132963 Sep 07 07:55:48.615305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 29/63] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:48 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1340 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:49.255918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:49.257043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:49.262541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.263021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.263677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.264544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.264997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.265423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.412727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:49.425818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:49.426873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:49.428790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb8f337d-be4f-411b-9196-d95b46c8fa7a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.176336 Sep 07 07:55:49.429572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 35/64] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:49 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:49.444453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.444453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.444453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.444453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.445382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.445382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.591079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:49.600789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc2e6473-cd7c-41f3-8aca-ea8b06bdc58b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.179020 Sep 07 07:55:49.602276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 30/65] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:49 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:49.645258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:49.646775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:49.649182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:49.650287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:49.655575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.656311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.657228 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.658134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.658934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.659532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.665138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.666400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.667030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.668455 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:49.669066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:49.669634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:49.966418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:49.980721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0dd6df7-2110-410a-8c13-5dfa41f2addd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.339918 Sep 07 07:55:49.981313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 36/66] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:49 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:50.014559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:50.026438 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:50.033666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:50.035300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-416dc576-87ce-4436-a047-98e4d1136f36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1340 microversion: 2.20 time: 0.390856 Sep 07 07:55:50.036598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 31/67] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:49 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1340 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:55:50.455121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:50.457577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:50.470394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:50.472535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:50.473045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:50.473979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:50.474958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:50.477423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:50.624541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:50.626065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:50.634719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:50.635579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:50.636797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:50.637825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:50.638496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:50.639122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:50.798356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:50.808512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9deef7b5-c1ca-4c56-9a32-4a78364741d9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.357417 Sep 07 07:55:50.813742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 37/68] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:50 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:50.860969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:50.875536 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1f35bb4b-37f0-4727-86a0-5c6470b1915c tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.254241 Sep 07 07:55:50.876691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 32/69] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:50 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:51.008074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:51.008906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:51.049361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.050346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.050968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.051898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.052523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.053088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.068508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:51.069226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:51.073872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:51.084711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.085216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.086616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.090069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.094105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.097278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.149939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:51.203400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:51.212764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:51.214698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:51.216151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f6da0c83-f06b-4ab9-952a-51d326469b93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1340 microversion: 2.20 time: 0.152377 Sep 07 07:55:51.216698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 33/70] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:51 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:51.280512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:51.290565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b68fc931-429a-48ab-ad59-e5757cc0eaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.286319 Sep 07 07:55:51.291176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 38/71] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:51 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:51.837497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:51.838118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:51.853867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.854381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.854791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.855488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.855935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.856570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.902315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:51.903096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:51.912027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.912856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.913841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.915673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:51.916581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:51.917212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:51.940831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:52.017751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:52.029185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f277dfa1-4d41-481f-b882-ba9512d565ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.196905 Sep 07 07:55:52.029888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 34/72] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:51 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:52.090350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:52.100601 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7fbca40a-179d-4e27-91b9-34879639929a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.205221 Sep 07 07:55:52.117120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 39/73] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:51 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:52.242908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:52.243764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:52.250207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:52.250705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:52.251215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:52.251833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:52.252328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:52.252756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:52.312638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:52.313258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:52.323606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:52.324801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:52.327865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:52.333268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:52.333630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:52.334117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:52.334555 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:52.341493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:52.345629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:52.349308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-03d6f263-02a3-49b2-ae57-8a1ce1040575 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1340 microversion: 2.20 time: 0.111834 Sep 07 07:55:52.361787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 35/74] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:52 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1340 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:52.530437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:52.538458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85d397b2-61b4-4ec1-9bc6-661b567d3363 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.230161 Sep 07 07:55:52.539062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 40/75] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:52 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:53.055142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:53.056671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:53.064948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.065549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.065994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.067472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.078835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.079556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.126996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:53.127597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:53.141414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:53.142412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:53.144248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.144955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.145701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.146634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.147443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.147828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.331426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:53.349485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5c693799-67da-4edf-86a9-c9cecdbf4f72 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.298747 Sep 07 07:55:53.350434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 36/76] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:53 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:53.378116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:53.379187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:53.392116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.392116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.392116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.396251 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.396804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.397297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.417096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:53.429150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76a0b3a8-9fd5-4f9f-a34c-9f7426d2e183 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.306594 Sep 07 07:55:53.437535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 41/77] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:53 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:53.528402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:53.549447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:53.556153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:53.561798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:53.562628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:53.569249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.573998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b7aaaba-2578-4d80-ab67-b15585b246c7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1340 microversion: 2.20 time: 0.199339 Sep 07 07:55:53.576739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 37/78] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:53 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:55:53.578314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.578775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.579510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:53.579969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:53.580983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:53.685935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=24 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:53.833509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:53.857112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6539df84-617e-4b15-a2db-f6a94797ad17 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.295892 Sep 07 07:55:53.864583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 42/79] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:53 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:54.374743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:54.375346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:54.390621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.391127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.399559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:54.400429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.400915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.401390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:54.471357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:54.471357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:54.495234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.495746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.499640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:54.501079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.501898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.502542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:54.849906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:54.865002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:54.876486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c3e02675-0ef5-4e08-a61e-ed5d0f94ddb5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.504133 Sep 07 07:55:54.876486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 38/80] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:54 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:54.883293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:54.886172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:54.887130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b913f694-9e11-43dd-8cb1-ddd1f7944ce0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.421755 Sep 07 07:55:54.896190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 43/81] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:54 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:54.902985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:54.903607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:54.910760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.911248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.922041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:54.922041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.922041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.922041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:54.922678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.922678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.922678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:54.922678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:54.922979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:54.922979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:55.045217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:55.064496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:55.066897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:55.068203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-894ea825-540f-4632-8921-5a80467351ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1340 microversion: 2.20 time: 0.190713 Sep 07 07:55:55.069459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 39/82] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:54 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1340 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:55.135359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:55.143506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03e6635c-809b-403f-9f21-e8e17790f1d5 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.246001 Sep 07 07:55:55.144194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 44/83] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:54 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:55.900008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:55.900654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:55.911408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:55.912600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:55.931189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:55.932652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:55:55.934621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:55.935448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:55.937131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:55.937822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:55.937967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:55.939119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:55.940001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:55.940646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:55.941383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:55.942218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:55.942981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:56.530216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:56.542473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b4924a3d-112a-4e9f-a1d6-4af8a4a1dd2e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.635625 Sep 07 07:55:56.543295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 45/84] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:55 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:56.548626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:56.549463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:56.556441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:56.557221 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:56.557931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:56.558978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:56.559498 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:56.560006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:56.950780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:56.958972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c75928c0-130d-4fde-8cf9-5f1623b3374f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 1.063240 Sep 07 07:55:56.959599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:55 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:56.964691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:56.965292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:56.983546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:56.984041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:56.984514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:56.989092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:56.989714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:56.990254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:57.195838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:57.204466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:57.206303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:57.207722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c43103f8-453f-4388-bf09-c6648bb665f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.663285 Sep 07 07:55:57.208894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 46/86] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:56 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:57.217805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ba74e22b-6108-4420-9d41-c2938d2cba9d req-19f59095-36fa-4274-8230-49009020571e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a1e65-1d0a-4462-928c-e0b7610c2180", "tag": "d3200a8b-180c-48b9-b687-e420d53e9630"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:57.252026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba74e22b-6108-4420-9d41-c2938d2cba9d req-19f59095-36fa-4274-8230-49009020571e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:57.252026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba74e22b-6108-4420-9d41-c2938d2cba9d req-19f59095-36fa-4274-8230-49009020571e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:57.252026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba74e22b-6108-4420-9d41-c2938d2cba9d req-19f59095-36fa-4274-8230-49009020571e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:57.303345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ba74e22b-6108-4420-9d41-c2938d2cba9d req-19f59095-36fa-4274-8230-49009020571e service nova] Creating event network-changed:d3200a8b-180c-48b9-b687-e420d53e9630 for instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 on hv-cinder-83602 Sep 07 07:55:57.304206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba74e22b-6108-4420-9d41-c2938d2cba9d req-19f59095-36fa-4274-8230-49009020571e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 07:55:57.305621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba74e22b-6108-4420-9d41-c2938d2cba9d req-19f59095-36fa-4274-8230-49009020571e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 07:55:57.306858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:57.307492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:57.309447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:57.313123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:57.313660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:57.314277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:57.337580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.compute.rpcapi [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 07:55:57.338600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] Releasing lock "compute-rpcapi-router" {{(pid=120494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 07:55:57.368266 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0151683f-dc66-48f5-838b-20f507f92af4 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157106 Sep 07 07:55:57.371116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 47/87] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:57.568497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:57.569209 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:57.579384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:57.579950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:57.580489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:57.581124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:57.581621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:57.582087 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:57.846204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:57.865429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-72144e78-b478-45b6-bd10-9abae7e4bfcd tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.302410 Sep 07 07:55:57.868774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 48/88] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:57 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:57.983271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:57.984609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:57.987666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:57.999017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6f4314df-d6dc-48d2-897f-a5ff9229ac58 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 1.037952 Sep 07 07:55:58.000208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 41/89] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:56 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:58.021565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:58.023968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:58.025684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:58.027017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:58.027629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:58.028149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:58.241003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:58.241932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:58.263760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:58.264531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:58.265635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:58.266632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:58.267234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:58.267804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:58.392920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:58.410108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40f4b5d5-73ff-4057-9486-51b66616a285 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.423686 Sep 07 07:55:58.411058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 49/90] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:57 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:55:58.897792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:58.898845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:58.906374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:58.907153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:58.907919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:58.910351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:58.911567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:58.912232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:59.157669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:59.169709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:59.172371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:59.174648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b2dfb76f-5841-4e92-bd2f-ecc0fd6a6c56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.939811 Sep 07 07:55:59.175896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 42/91] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:55:58 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:55:59.197448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:59.217488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:59.230309 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:59.233451 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:59.255040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11090779-520f-42ef-8195-7d0c6ef9bf32 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.361907 Sep 07 07:55:59.255294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:59.256004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:59.258789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:59.259664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:59.260831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:59.271822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 50/92] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:58 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:59.438968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:55:59.439569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:55:59.451623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:59.452147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:59.452731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:59.455258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:59.456013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:59.456666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:59.752103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:59.767890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f4aa3ff-4bf0-4c7c-9be9-3d23d2a0e205 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.332482 Sep 07 07:55:59.782951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 51/93] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:59 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:55:59.782951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-1cf8cdec-0e9f-49b7-9dbc-92ec07e4315c req-d28d02ea-4b2a-4957-899a-2bd5aceb93cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bf06d0-30dc-4a08-94a4-bac302f07efb", "tag": "21b12ceb-ddd4-48f9-8f8c-e7c2fd169986"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:55:59.834788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1cf8cdec-0e9f-49b7-9dbc-92ec07e4315c req-d28d02ea-4b2a-4957-899a-2bd5aceb93cf service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:55:59.839287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1cf8cdec-0e9f-49b7-9dbc-92ec07e4315c req-d28d02ea-4b2a-4957-899a-2bd5aceb93cf service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:55:59.841166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-1cf8cdec-0e9f-49b7-9dbc-92ec07e4315c req-d28d02ea-4b2a-4957-899a-2bd5aceb93cf service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:55:59.876451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-1cf8cdec-0e9f-49b7-9dbc-92ec07e4315c req-d28d02ea-4b2a-4957-899a-2bd5aceb93cf service nova] Creating event network-changed:21b12ceb-ddd4-48f9-8f8c-e7c2fd169986 for instance 86bf06d0-30dc-4a08-94a4-bac302f07efb on hv-cinder-83602 Sep 07 07:55:59.883219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-1cf8cdec-0e9f-49b7-9dbc-92ec07e4315c req-d28d02ea-4b2a-4957-899a-2bd5aceb93cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112549 Sep 07 07:55:59.883929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 52/94] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:55:59.903232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:55:59.942531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2c9a9457-a151-4f4c-b627-99a75b17e06f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.750915 Sep 07 07:55:59.943348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 43/95] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:55:59 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:00.201647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:00.202353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:00.210231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.211441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.212031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.212934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.213532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.214126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.295548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:00.296109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:00.305451 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.306473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.307068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.309229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.309706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.310138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.417618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:00.427953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:00.430206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:00.431664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1642a2d6-0878-4008-9f98-7e048fdd8b44 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.234238 Sep 07 07:56:00.432404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 53/96] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:00 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:00.550212 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:00.558707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-873a174e-1c3a-492a-bc98-c02b5eaaeaca tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.268550 Sep 07 07:56:00.564632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 44/97] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:00 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:00.797352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:00.798282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:00.805696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.806444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d1b7833c-96e2-4a33-8024-ef9946eec199 req-31b5bb59-25a9-4997-a737-a37b8a0dff85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d122d8-2187-49e4-82c7-839909d10854", "name": "network-vif-plugged", "status": "completed", "tag": "40819e72-6b92-48e6-8907-95585c9cb368"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:00.806894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.807502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.808613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.810014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.810642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.849345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d1b7833c-96e2-4a33-8024-ef9946eec199 req-31b5bb59-25a9-4997-a737-a37b8a0dff85 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.850011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d1b7833c-96e2-4a33-8024-ef9946eec199 req-31b5bb59-25a9-4997-a737-a37b8a0dff85 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.850453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d1b7833c-96e2-4a33-8024-ef9946eec199 req-31b5bb59-25a9-4997-a737-a37b8a0dff85 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.867172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d1b7833c-96e2-4a33-8024-ef9946eec199 req-31b5bb59-25a9-4997-a737-a37b8a0dff85 service nova] Creating event network-vif-plugged:40819e72-6b92-48e6-8907-95585c9cb368 for instance c7d122d8-2187-49e4-82c7-839909d10854 on hv-cinder-83602 Sep 07 07:56:00.875407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d1b7833c-96e2-4a33-8024-ef9946eec199 req-31b5bb59-25a9-4997-a737-a37b8a0dff85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164483 Sep 07 07:56:00.876870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 54/98] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:56:00.968129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:00.969267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:00.983942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.985928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.990290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:00.991338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:00.993425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:00.994223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:01.318901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:01.329187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2726d7b4-3d55-4979-9bc4-abbd74b1c1a3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.536518 Sep 07 07:56:01.340132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 45/99] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:00 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:01.342125 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:01.350490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a09dd4e1-6d5d-4520-8183-e0af04b583d3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.387557 Sep 07 07:56:01.363991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 55/100] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:00 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:01.458098 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:01.458955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:01.465599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:01.466346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:01.467039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:01.467917 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:01.468542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:01.469112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:01.582793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:01.583687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:01.590692 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:01.591348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:01.591961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:01.592852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:01.593460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:01.594038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:01.635015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:01.652763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:01.654468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:01.655782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c3e6ce78-d14f-47ea-a307-c68cca034c0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.201755 Sep 07 07:56:01.670301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 46/101] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:01 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:01.769934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:01.779419 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8ba72a5-7606-4841-a05b-5ed76221b559 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.200500 Sep 07 07:56:01.779992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 56/102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:01 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:02.354597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:02.355962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:02.367295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.367789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.369555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.370392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.370937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.371395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.375409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:02.376073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:02.401826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.402340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.403773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.404431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.404891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.405315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.550920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:02.559482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-136e9b1e-63ee-4257-bad8-58fc74cebe9e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.209208 Sep 07 07:56:02.560178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 47/103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:02 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:02.616744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:02.622004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:02.629454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-302ca452-5788-4a02-bd01-6228e40ab55b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.258458 Sep 07 07:56:02.632131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 57/104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:02 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:02.684068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:02.684943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:02.691867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.692381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.692813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.693823 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.694462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.695595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.802749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:02.803366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:02.809641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.810208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.810712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.811474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:02.812002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:02.812520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:02.880326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:02.889589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:02.891128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:02.892756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-770df7f2-b135-4870-8fae-39bce22d0084 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.213261 Sep 07 07:56:02.913662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 48/105] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:02 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:02.971382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:02.979595 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c35764db-c6ba-47f2-9277-f2971de3875a tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.181025 Sep 07 07:56:02.980204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 58/106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:02 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:03.582119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:03.582724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:03.589482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:03.589992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:03.590424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:03.591106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:03.591556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:03.591972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:03.654378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:03.654996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:03.662295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:03.662784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:03.663225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:03.663940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:03.665009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:03.665449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:03.863367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:03.878705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba166883-4583-4234-9b30-ac1dfbfdf58a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.226751 Sep 07 07:56:03.897632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 59/107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:03 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:03.921857 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:03.923446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:03.932720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:03.933763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:03.936934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:03.938443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:03.940486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:03.942017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:03.956555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:03.966074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bdcc9abc-178c-40dc-8c42-cb965e2d0e5f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.387664 Sep 07 07:56:03.973899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 49/108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:03 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:04.013710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:04.014706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:04.026213 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:04.026760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:04.027392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:04.028204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:04.028987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:04.029339 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:04.035861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:04.151229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:04.159968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:04.161463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:04.162609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-308a401d-b70b-4e0a-b6b7-77edcd757a2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.245505 Sep 07 07:56:04.165011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 60/109] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:03 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:04.522133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:04.536046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-05c7f5a3-a509-4da5-8cdd-0f23bfd1dfd7 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.535188 Sep 07 07:56:04.549519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 50/110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:03 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:04.903493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:04.904255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:04.912418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:04.912886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:04.913539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:04.914248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:04.914699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:04.915120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:04.997065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:05.001513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:05.022129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:05.022852 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:05.023579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:05.024549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:05.025081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:05.025669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:05.085011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:05.095038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c6794a6-2ea2-46c5-af0c-104a814b8189 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.195899 Sep 07 07:56:05.095964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 61/111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:04 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:05.184437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:05.190770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:05.191973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:05.194354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e35cf33f-9c7f-4d90-bfcf-a3b1414eaf7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.201509 Sep 07 07:56:05.195525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 51/112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:04 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:05.200320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:05.200817 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:05.201408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:05.202119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:05.202577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:05.203003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:05.390936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:05.400597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:05.402099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:05.403220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7880277d-3f11-469e-8eac-54b7a6e68aa3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.216302 Sep 07 07:56:05.403859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 62/113] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:05 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:56:05.563010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:05.563645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:05.570594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:05.571092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:05.571534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:05.572402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:05.572727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:05.573252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:05.755348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:05.764942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cf4fa9a6-aa50-4f12-8525-1922145e0733 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.205640 Sep 07 07:56:05.765749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 52/114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:05 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:06.103657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5768359f-f86a-48d5-ae8f-782111609106 req-401bd678-fb6a-43ab-8a6d-50021877ba71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e63064-b3e0-4870-b57d-c075177e98ce", "name": "network-vif-plugged", "status": "completed", "tag": "d2f19dac-b216-473d-b233-7f59237c680e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:06.118508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:06.119818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:06.126697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5768359f-f86a-48d5-ae8f-782111609106 req-401bd678-fb6a-43ab-8a6d-50021877ba71 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.128563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.129279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5768359f-f86a-48d5-ae8f-782111609106 req-401bd678-fb6a-43ab-8a6d-50021877ba71 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.129952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5768359f-f86a-48d5-ae8f-782111609106 req-401bd678-fb6a-43ab-8a6d-50021877ba71 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.133069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.134165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.137363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.138022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.141106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.161234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5768359f-f86a-48d5-ae8f-782111609106 req-401bd678-fb6a-43ab-8a6d-50021877ba71 service nova] Creating event network-vif-plugged:d2f19dac-b216-473d-b233-7f59237c680e for instance d3e63064-b3e0-4870-b57d-c075177e98ce on hv-cinder-83602 Sep 07 07:56:06.172285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5768359f-f86a-48d5-ae8f-782111609106 req-401bd678-fb6a-43ab-8a6d-50021877ba71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074119 Sep 07 07:56:06.176869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 63/115] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:56:06.222201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:06.224212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:06.246886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.247870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.249325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.250337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.251047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.251685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.439734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:06.450145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-70043de5-1ab0-46e6-969b-8c5dd2e6fd68 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.335429 Sep 07 07:56:06.450771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 53/116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:06 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:06.464522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:06.465560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:06.473942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.474656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.475302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.477093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.477776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.478415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.515547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:06.523517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5db1e3b2-84c8-4dcf-9bb7-a0ed3b8854fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.305892 Sep 07 07:56:06.525574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 64/117] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:06 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:06.703044 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:06.716417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:06.718373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:06.719484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2f3f3376-ef02-4a1e-b8b5-dcd70d8b1852 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.267639 Sep 07 07:56:06.720620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 54/118] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:06 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:06.796016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:06.798251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:06.807605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.809195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.809926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:06.811593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:06.812715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:06.813464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:07.050393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:07.061206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb9243c8-ea63-4476-af9c-3ad648c05ca8 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.275338 Sep 07 07:56:07.062235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 65/119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:06 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:07.476409 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:07.477068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:07.485533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:07.486347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:07.487065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:07.487914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:07.488540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:07.489112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:07.549356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:07.549964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:07.556067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:07.559460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:07.560186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:07.560825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:07.561748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:07.562405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:07.563023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:07.657840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:07.667381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8bd9090e-5555-467c-8198-31f776aefcdf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.195898 Sep 07 07:56:07.668706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 55/120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:07 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:07.747358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:07.748284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:07.755481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:07.756189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:07.756993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:07.758321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:07.759007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:07.759570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:07.908797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:07.918726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:07.920458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:07.920591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:07.923403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-27180b4d-2221-441b-ae91-627f0f99ef14 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.180130 Sep 07 07:56:07.940115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 56/121] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:07 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:07.951652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-064403ef-9ba2-4f67-b5d1-938e1a654995 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.406087 Sep 07 07:56:07.952256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 66/122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:07 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:08.085526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:08.086543 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:08.093267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.093763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.094199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.095065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.095531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.095957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.239865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:08.249441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-10fcf3f7-67e9-46ba-81ca-32cfd842cdce tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.168314 Sep 07 07:56:08.250364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 57/123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:08 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:08.332793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8eccd8f1-2e8e-4e16-b7be-6797b97d5f70 req-4de50cc9-a555-42eb-a72c-84734478803e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee87953e-ba27-4c28-b0db-0dfa81b496e6", "name": "network-vif-plugged", "status": "completed", "tag": "e3286f12-f5f4-4c6b-9125-ae90c9cdaefa"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:08.342491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8eccd8f1-2e8e-4e16-b7be-6797b97d5f70 req-4de50cc9-a555-42eb-a72c-84734478803e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.343347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8eccd8f1-2e8e-4e16-b7be-6797b97d5f70 req-4de50cc9-a555-42eb-a72c-84734478803e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.343832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8eccd8f1-2e8e-4e16-b7be-6797b97d5f70 req-4de50cc9-a555-42eb-a72c-84734478803e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.355659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8eccd8f1-2e8e-4e16-b7be-6797b97d5f70 req-4de50cc9-a555-42eb-a72c-84734478803e service nova] Creating event network-vif-plugged:e3286f12-f5f4-4c6b-9125-ae90c9cdaefa for instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 on hv-cinder-83602 Sep 07 07:56:08.362131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8eccd8f1-2e8e-4e16-b7be-6797b97d5f70 req-4de50cc9-a555-42eb-a72c-84734478803e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 Sep 07 07:56:08.363298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 67/124] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:56:08.692944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:08.693596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:08.700591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.701225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.701481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.702329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.702594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.703008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.854126 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:08.862990 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b8461518-d4f4-4a1b-8735-e62eef279638 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.173995 Sep 07 07:56:08.863555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 58/125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:08 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:08.950803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:08.952512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:08.958821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.959540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.960837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.962164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.962777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.963958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.979932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:08.981006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:08.990016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.991083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.992225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:08.993251 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:08.993992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:08.994774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:09.268839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:09.310789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:09.318528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:09.320184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2e73de8-f776-4b1a-87ce-ff8ff7c10a78 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.373151 Sep 07 07:56:09.322257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 68/126] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:08 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:56:09.334871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:09.339099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:09.349693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:09.350128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:09.353577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:09.355119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:09.368740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:09.369491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:09.577543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:09.589193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-81427ab1-7f27-4361-adf3-65b47501b07b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1315 microversion: 2.1 time: 0.265477 Sep 07 07:56:09.590155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 69/127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:09 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:09.653119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:09.672913 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d675262c-2ac9-4548-8df0-809498c51a69 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.698962 Sep 07 07:56:09.673528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 59/128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:08 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:09.886382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:09.886988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:09.892958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:09.893429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:09.893853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:09.894525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:09.894969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:09.895384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:10.030078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:10.037659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-110bed03-c2b2-42e6-b28e-8449cbe2f006 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.155712 Sep 07 07:56:10.038257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 70/129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:09 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:10.351357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:10.352155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:10.358548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:10.359116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:10.359580 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:10.360320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:10.360898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:10.361260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:10.529465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:10.537872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:10.539990 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:10.541254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b2486157-0d36-4ef8-92c1-410d486caf4d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.194278 Sep 07 07:56:10.541909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 60/130] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:10 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:10.618861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:10.623338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:10.630543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:10.631356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:10.631769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:10.639919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:10.639919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:10.639919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:10.708664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:10.708664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:10.722400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:10.723169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:10.723498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:10.724254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:10.724713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:10.725136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:10.815235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:10.825064 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-59adb4bb-c9e1-49cc-82cf-211334a8b883 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1502 microversion: 2.1 time: 0.212597 Sep 07 07:56:10.826088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 71/131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:10 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:10.907256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:10.916574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-55e28a6b-4810-48cd-8b18-2a09b1cbfec0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.224815 Sep 07 07:56:10.917588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 61/132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:10 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:11.062134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:11.062134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:11.071365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:11.081836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:11.082294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:11.083073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:11.083505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:11.084016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:11.261031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:11.269106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6776374f-a119-4b7d-991b-e19a921f7455 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.211521 Sep 07 07:56:11.269728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 72/133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:11 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:11.566091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:11.566979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:11.573865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:11.574350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:11.574784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:11.575630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:11.576116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:11.577047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:11.706290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:11.714444 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:11.715969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:11.717159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-35342d68-51fc-46b0-b7dc-f686004246ba tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.154876 Sep 07 07:56:11.717762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 62/134] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:11 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:11.938815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:11.939416 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:11.945908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:11.946395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:11.946824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:11.947528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:11.947977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:11.948420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:12.091246 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:12.099113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5234288-da30-4eab-b9cf-c8446806189e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.164098 Sep 07 07:56:12.099681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 73/135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:11 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:12.294851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:12.295838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:12.304710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:12.305657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:12.306494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:12.307751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:12.308630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:12.309649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:12.457877 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:12.467734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-94e1112f-33c6-445c-b6ad-4b502c4edd41 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.177550 Sep 07 07:56:12.468350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 63/136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:12 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:12.743114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:12.743717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:12.749762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:12.750244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:12.750678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:12.751374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:12.751823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:12.752293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:12.901169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:12.909439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:12.911025 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:12.912026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-159fb19f-c497-4296-bc8b-6569b14b4620 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.172898 Sep 07 07:56:12.912618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 74/137] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:12 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:56:13.122707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:13.123373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:13.129104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:13.129588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:13.130036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:13.130906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:13.131284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:13.131946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:13.288620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:13.299681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eb38577f-c21d-47d4-b503-aa62f072edb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.180617 Sep 07 07:56:13.300287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 64/138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:13 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:13.491915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:13.493424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:13.499773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:13.500300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:13.500735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:13.501422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:13.501783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-9ff44337-5768-4f13-a017-04ffbeda60d5 req-6a0489a8-32b0-45ab-a95a-c6adbc2d88fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a1e65-1d0a-4462-928c-e0b7610c2180", "name": "network-vif-plugged", "status": "completed", "tag": "d3200a8b-180c-48b9-b687-e420d53e9630"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:13.502234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:13.502816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:13.512336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9ff44337-5768-4f13-a017-04ffbeda60d5 req-6a0489a8-32b0-45ab-a95a-c6adbc2d88fd service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:13.513797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9ff44337-5768-4f13-a017-04ffbeda60d5 req-6a0489a8-32b0-45ab-a95a-c6adbc2d88fd service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:13.514665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9ff44337-5768-4f13-a017-04ffbeda60d5 req-6a0489a8-32b0-45ab-a95a-c6adbc2d88fd service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:13.528258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-9ff44337-5768-4f13-a017-04ffbeda60d5 req-6a0489a8-32b0-45ab-a95a-c6adbc2d88fd service nova] Creating event network-vif-plugged:d3200a8b-180c-48b9-b687-e420d53e9630 for instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 on hv-cinder-83602 Sep 07 07:56:13.533657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-9ff44337-5768-4f13-a017-04ffbeda60d5 req-6a0489a8-32b0-45ab-a95a-c6adbc2d88fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035460 Sep 07 07:56:13.534513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 65/139] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:56:13.656505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:13.660067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:13.672182 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3000aea-b999-4fe0-b29e-0150c196372a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.178909 Sep 07 07:56:13.672182 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 75/140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:13 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:13.937646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:13.938448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:13.945739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:13.946407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:13.946856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:13.947550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:13.948002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:13.948622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:14.096059 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:14.104819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:14.106273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:14.107329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-48e2aca4-049a-42a3-a493-a4d272fedb3f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.173900 Sep 07 07:56:14.107869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 66/141] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:13 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:14.337885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:14.338692 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:14.344798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:14.345274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:14.345699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:14.346382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:14.346830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:14.347250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:14.481876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:14.489508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2ea43e2-405e-4ac4-a176-c757f83cd61f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.170168 Sep 07 07:56:14.490074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 76/142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:14 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:14.692713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:14.693346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:14.700339 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:14.700924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:14.701262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:14.701964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:14.702423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:14.702855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:14.722873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:14.838720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:14.846677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5f9ff541-0275-4488-af5a-a4960070ff90 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.158503 Sep 07 07:56:14.847232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 67/143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:14 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:15.132770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:15.134121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:15.141133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:15.141642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:15.142103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:15.142813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:15.143242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:15.143672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:15.304392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:15.313106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:15.314156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:15.315250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0793cdbe-271e-4854-ba5b-d6b92bbb521e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.187217 Sep 07 07:56:15.316679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 77/144] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:15 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:15.513700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:15.514304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:15.520230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:15.520705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:15.521133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:15.521811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:15.522257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:15.522703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:15.661946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:15.670280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9abcc7ed-901a-4f14-922e-bb489435056d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.160730 Sep 07 07:56:15.670838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 68/145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:15 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:15.869966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:15.870662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:15.876967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:15.877455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:15.877893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:15.879200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:15.879664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:15.880099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:16.015283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:16.023064 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8defde29-a0fc-4ab3-9d8c-7af3d9017229 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.157413 Sep 07 07:56:16.023842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 78/146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:15 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:16.341704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:16.342396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:16.349682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:16.350264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:16.351710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:16.352390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:16.352930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:16.353274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:16.496525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:16.507812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:16.509656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:16.510782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aaa90f69-5855-4b23-8263-eac52cbe51f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.173049 Sep 07 07:56:16.511608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 69/147] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:16 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:16.696372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:16.697725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:16.705638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:16.706122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:16.706553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:16.707343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:16.707860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:16.708338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:16.850007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:16.859563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2038a5ee-d091-41ad-b5c6-bf8fc439d047 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1321 microversion: 2.1 time: 0.169368 Sep 07 07:56:16.860496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 79/148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:16 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:17.011384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-2ff2ab03-2bd6-4b48-9ec9-dd23a7aa6f6c req-897ba98a-4169-462d-a820-4f19c5671a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bf06d0-30dc-4a08-94a4-bac302f07efb", "name": "network-vif-plugged", "status": "completed", "tag": "21b12ceb-ddd4-48f9-8f8c-e7c2fd169986"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:17.021756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2ff2ab03-2bd6-4b48-9ec9-dd23a7aa6f6c req-897ba98a-4169-462d-a820-4f19c5671a63 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.022245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2ff2ab03-2bd6-4b48-9ec9-dd23a7aa6f6c req-897ba98a-4169-462d-a820-4f19c5671a63 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.023458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2ff2ab03-2bd6-4b48-9ec9-dd23a7aa6f6c req-897ba98a-4169-462d-a820-4f19c5671a63 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.035215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-2ff2ab03-2bd6-4b48-9ec9-dd23a7aa6f6c req-897ba98a-4169-462d-a820-4f19c5671a63 service nova] Creating event network-vif-plugged:21b12ceb-ddd4-48f9-8f8c-e7c2fd169986 for instance 86bf06d0-30dc-4a08-94a4-bac302f07efb on hv-cinder-83602 Sep 07 07:56:17.043909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-2ff2ab03-2bd6-4b48-9ec9-dd23a7aa6f6c req-897ba98a-4169-462d-a820-4f19c5671a63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036467 Sep 07 07:56:17.045028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 70/149] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:56:17.047435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:17.052906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:17.065351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.066146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.066806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.073160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.073633 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.074234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.264474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:17.272918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-147e23c7-6479-400b-97d5-6b650176c1b0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.230688 Sep 07 07:56:17.273515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 80/150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:17 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:17.537083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:17.537699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:17.544608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.545419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.545957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.546664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.547348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.547822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.624196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79f64b86-7c3c-4a3c-9cbe-137f6fb1ecd2"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:17.629367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:17.639968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.640750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.641292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.642249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.642870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.644116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.703941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:17.714425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:17.716964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:17.718644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-34121404-e9ff-45e6-91ab-852f5417cd79 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.186538 Sep 07 07:56:17.719693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 71/151] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:17 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:17.885628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:17.886344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:17.895517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.896518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.899265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:17.900333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:17.900898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:17.901572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.072699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:18.080623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b5ea9934-b68e-4232-acf1-2054e7f6c6ab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1515 microversion: 2.1 time: 0.199787 Sep 07 07:56:18.081191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 72/152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:17 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:18.104391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:18.106560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:18.112424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.112916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.113358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.114053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.114613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.115070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.177423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lazy-loading 'flavor' on Instance uuid d3e63064-b3e0-4870-b57d-c075177e98ce {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:56:18.313090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6c8a246f-faca-46fb-9875-70d85f7aea99 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce/action" status: 200 len: 32 microversion: 2.1 time: 0.212514 Sep 07 07:56:18.327128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 73/153] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:56:18 2022] POST /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 07:56:18.331646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:18.332500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:18.344533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.347005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.347459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.348667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.349147 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.349538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.696252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:18.704295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b888a5b6-dd14-4686-991f-7a6380cfaf1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.383357 Sep 07 07:56:18.705070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:18 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:18.709498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:18.710321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:18.716518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.716980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.717405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.718446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.718888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.719311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.731928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1d2f928-0eb5-4e3b-bcb4-d5c744e91f7f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "POST /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112642 Sep 07 07:56:18.733098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 81/155] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 07:56:17 2022] POST /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854/os-volume_attachments => generated 194 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:56:18.745458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:18.746147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:18.752764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.753467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.754042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.754941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:18.755526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:18.756107 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:18.888333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:18.896124 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fd5df36b-d9f3-4eea-be31-5d6ea700aca2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.190047 Sep 07 07:56:18.896698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 75/156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:18 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:18.921438 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:18.930271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:18.931705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:18.932821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53c62df7-42eb-4aca-be8e-9a0821e9fc60 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.192428 Sep 07 07:56:18.933375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 82/157] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:18 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:56:19.729149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:19.730060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:19.737248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:19.738138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:19.738788 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:19.739725 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:19.740219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:19.741808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:19.919417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:19.921049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:19.928005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:19.929361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:19.930198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:19.931237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:19.931921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:19.932606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:20.150390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:20.159573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83ccc8ff-b3c5-435c-aac8-052647a06544 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.244570 Sep 07 07:56:20.160556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 83/158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:19 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:20.166189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:20.166988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:20.173167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:20.174170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:20.174978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:20.175956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:20.176553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:20.177353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:20.193130 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:20.202002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f8bb4722-88a2-4d11-ada3-07b560f4b924 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1367 microversion: 2.1 time: 0.478946 Sep 07 07:56:20.202584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 76/159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:19 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:20.342069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:20.354010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:20.355667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:20.357314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c54770ba-125d-47c3-a9f5-0c84491e1f85 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.195311 Sep 07 07:56:20.358019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 84/160] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:20 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:21.186667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:21.187386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:21.189544 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=87 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:21.195296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.195872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.196419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.197188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.197719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.198219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.227655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:21.228298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:21.235183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.235866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.236490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.237347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.237805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.238236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.342897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:21.361620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-220b1827-e1c2-4342-ab98-067c2a232fab tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.179242 Sep 07 07:56:21.372107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 77/161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:21 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:21.384587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:21.385904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:21.394021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.396691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.397743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.400525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.401005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.401442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.402674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:21.412673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16ef94a6-f471-4b0e-a97c-626270230044 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1557 microversion: 2.1 time: 0.189317 Sep 07 07:56:21.420602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 85/162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:21 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:21.440989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:21.443070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:21.451451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.452393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.453350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.454218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:21.454999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:21.455603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:21.558684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75d52188-4e9a-4308-92cb-ad4575022773 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121910 Sep 07 07:56:21.559893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 86/163] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 07:56:21 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:56:21.775543 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:21.785237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:21.787041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:21.788721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ace9cda4-67c7-462d-bef6-1475943a3f28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.409322 Sep 07 07:56:21.789664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 78/164] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:21 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:22.391300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:22.403765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:22.423352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:22.424131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:22.425645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:22.426678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:22.427997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:22.428679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:22.814090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:22.814692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:22.820997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:22.821688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:22.822297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:22.823154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:22.824174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:22.824756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:22.851140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:22.863357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ae55876-7b23-4cb4-9911-958af4d50326 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.479594 Sep 07 07:56:22.866080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 87/165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:22 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:23.245218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:23.253598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:23.260114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:23.261378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-352b83e1-31ba-4c82-b734-983d08457fcc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.451231 Sep 07 07:56:23.261936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 79/166] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:22 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:23.287053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2200c870-2af9-4405-950e-2d2f18c11abf req-346093e4-3bfd-491e-8065-945a09cd616f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3a1e65-1d0a-4462-928c-e0b7610c2180", "tag": "d3200a8b-180c-48b9-b687-e420d53e9630"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:23.293441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=93 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:23.300437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2200c870-2af9-4405-950e-2d2f18c11abf req-346093e4-3bfd-491e-8065-945a09cd616f service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:23.301562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2200c870-2af9-4405-950e-2d2f18c11abf req-346093e4-3bfd-491e-8065-945a09cd616f service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:23.302580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2200c870-2af9-4405-950e-2d2f18c11abf req-346093e4-3bfd-491e-8065-945a09cd616f service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:23.318471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2200c870-2af9-4405-950e-2d2f18c11abf req-346093e4-3bfd-491e-8065-945a09cd616f service nova] Creating event network-changed:d3200a8b-180c-48b9-b687-e420d53e9630 for instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 on hv-cinder-83602 Sep 07 07:56:23.324705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2200c870-2af9-4405-950e-2d2f18c11abf req-346093e4-3bfd-491e-8065-945a09cd616f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049476 Sep 07 07:56:23.325670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 88/167] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:56:23.888109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:23.888647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:23.895193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:23.895680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:23.896137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:23.896833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:23.903215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:23.904683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:24.170478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:24.185003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fd066e7b-7d57-4a70-8c7d-22323ec5a94c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.301326 Sep 07 07:56:24.201851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 80/168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:23 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:24.292278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:24.293138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:24.305719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:24.306210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:24.306643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:24.308187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:24.308648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:24.311616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:24.768716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:24.777276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:24.782871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:24.801486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-913727e7-fd6f-477f-9be4-7c94c933cd92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1407 microversion: 2.20 time: 0.514189 Sep 07 07:56:24.806383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 89/169] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:24 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:56:25.210042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:25.210643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:25.219540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:25.219969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:25.220460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:25.221148 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:25.226175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:25.227815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:25.832477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:25.837245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:25.838642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:25.844534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-252f83ce-b22d-4810-9f4c-c3fbccdbf25a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.638644 Sep 07 07:56:25.847566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 81/170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:25 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:25.855615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:25.859677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:25.860153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:25.860893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:25.871474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:25.871936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:26.267103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:26.288938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:26.292017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:26.294160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03586857-6186-49b7-b085-994059bc1af7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1599 microversion: 2.20 time: 0.464177 Sep 07 07:56:26.295248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 90/171] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:56:25 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1599 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:56:26.339291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:26.340858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:26.355966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:26.357532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:26.357979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:26.359670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:26.360154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:26.361652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:26.570413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c2e01b96-9057-4762-9335-e9ba0dd615c4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.242432 Sep 07 07:56:26.578894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 82/172] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Sep 7 07:56:26 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:56:26.877157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:26.877867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:26.889565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:26.891200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:26.891648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:26.895930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:26.897114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:26.897535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:27.376632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:27.387896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6a6d40e-102b-4f17-822a-060647e7fde0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.516873 Sep 07 07:56:27.388809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 91/173] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:26 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:28.192155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-44e53df3-9478-4f91-b58c-792cb7b2c905 req-79c7f582-b495-4469-9fb6-7d7b2cdecd37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bf06d0-30dc-4a08-94a4-bac302f07efb", "tag": "21b12ceb-ddd4-48f9-8f8c-e7c2fd169986"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:28.201998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-44e53df3-9478-4f91-b58c-792cb7b2c905 req-79c7f582-b495-4469-9fb6-7d7b2cdecd37 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:28.202491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-44e53df3-9478-4f91-b58c-792cb7b2c905 req-79c7f582-b495-4469-9fb6-7d7b2cdecd37 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:28.202930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-44e53df3-9478-4f91-b58c-792cb7b2c905 req-79c7f582-b495-4469-9fb6-7d7b2cdecd37 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:28.207162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:28.221982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-44e53df3-9478-4f91-b58c-792cb7b2c905 req-79c7f582-b495-4469-9fb6-7d7b2cdecd37 service nova] Creating event network-changed:21b12ceb-ddd4-48f9-8f8c-e7c2fd169986 for instance 86bf06d0-30dc-4a08-94a4-bac302f07efb on hv-cinder-83602 Sep 07 07:56:28.228343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-44e53df3-9478-4f91-b58c-792cb7b2c905 req-79c7f582-b495-4469-9fb6-7d7b2cdecd37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040121 Sep 07 07:56:28.229024 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 83/174] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:56:28.410837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:28.412158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:28.420485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:28.421271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:28.422067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:28.422828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:28.423390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:28.423821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:28.429193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:28.585527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:28.598989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7861c065-fbf7-4874-911e-618df5e2e81f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.191978 Sep 07 07:56:28.599577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 92/175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:28 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:29.623844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:29.626176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:29.633579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:29.634483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:29.635294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:29.636261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:29.637001 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:29.638326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:30.271708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:30.285887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b9520785-5428-462d-839f-7a8d4de009de tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.665127 Sep 07 07:56:30.304595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 84/176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:29 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:31.323519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:31.324307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:31.344632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:31.352180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:31.355239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:31.356324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:31.361013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:31.361785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:31.951164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:31.965245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-700fa912-139d-4c8b-846e-d0fe826a5561 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.644356 Sep 07 07:56:31.968410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 93/177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:31 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:32.991957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:32.992683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:33.018157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:33.019050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:33.019672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:33.020778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:33.021466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:33.022102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:33.288019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:33.300483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4ce8c722-5754-45c3-af7a-ddfeeed72f55 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.313089 Sep 07 07:56:33.301549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 85/178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:32 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:34.326176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:34.326919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:34.333744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:34.335126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:34.335948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:34.336762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:34.337484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:34.337995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:34.539733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:34.551272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5441615e-f76a-4212-b5de-cbba4975036f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.229028 Sep 07 07:56:34.560222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 94/179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:34 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:35.578683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:35.579935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:35.590437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:35.591221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:35.591668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:35.593603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:35.594078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:35.594910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:35.908542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:35.929711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-90b14bb8-6235-4946-90fc-38818de06d32 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.356444 Sep 07 07:56:35.930309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 86/180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:35 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:36.953504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:36.954274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:36.968149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:36.968746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:36.969364 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:36.970407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:36.971018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:36.971598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:37.298860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:37.326414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2fdf10d9-7299-4ae1-bc09-d0a48f62b045 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.376514 Sep 07 07:56:37.327098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 95/181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:36 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:38.351924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:38.352645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:38.389005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:38.389464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:38.389872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:38.390638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:38.391099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:38.391527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:38.692583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:38.702502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b2e4a761-03ba-49cf-ac3b-3fcaa008d7a0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.355967 Sep 07 07:56:38.703068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 87/182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:38 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:39.728897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:39.729620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:39.743519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:39.744282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:39.745275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:39.747866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:39.748365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:39.748832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:39.958447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:39.958447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:39.968227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:39.968721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:39.969152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:39.969860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:39.970297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:39.980514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:40.056210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 07:56:40.067084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:40.077203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af44bb03-eb6c-4f62-a3f6-f4809ace202b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.353956 Sep 07 07:56:40.093902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 96/183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:39 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:40.175846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-41f42369-8a21-47b7-84de-ad42812ca7cb tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 204 len: 0 microversion: 2.1 time: 0.221488 Sep 07 07:56:40.177076 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 88/184] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 07:56:39 2022] DELETE /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 07:56:40.186657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:40.187343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:40.198555 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:40.199299 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:40.199890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:40.200985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:40.201588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:40.202157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:40.359805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:40.369067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f5d74880-909f-4cac-a51e-37fc12c94ace tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1554 microversion: 2.1 time: 0.187140 Sep 07 07:56:40.369649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 97/185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:40 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:41.106118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:41.106809 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:41.117165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:41.117971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:41.118618 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:41.119538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:41.120340 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:41.120993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:41.400901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:41.402126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:41.409655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:41.410155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:41.410593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:41.417285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:41.417686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:41.418135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:41.431950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:41.441576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a1ee4bc9-c88c-4332-b020-496497da9160 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.339282 Sep 07 07:56:41.444318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 89/186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:41 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:41.638422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:41.653164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d588cae-7a2d-495f-b0cd-540b52094622 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1554 microversion: 2.1 time: 0.256096 Sep 07 07:56:41.655864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 98/187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:41 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1554 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:42.468390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:42.469784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:42.497428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:42.504590 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:42.505105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:42.506384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:42.506860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:42.510348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:42.682990 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:42.683540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:42.687366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:42.695602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:42.696319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:42.696980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:42.697661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-da1287c4-77c4-456f-bad7-089522e08d8b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.234439 Sep 07 07:56:42.697997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:42.698608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:42.699150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 90/188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:42 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:42.699603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:43.104234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:43.115929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-caf1b26e-e063-4152-993a-8b4e22e6bd5f tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1554 microversion: 2.1 time: 0.439823 Sep 07 07:56:43.117141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 99/189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:42 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1554 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:43.727206 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:43.728657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:43.747291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:43.750077 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:43.751551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:43.752532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:43.753193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:43.753948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:43.897570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0698277f-5214-4816-8a09-5f2f8f4853d5 req-d9859a78-23fe-449a-966d-4082f669c2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d122d8-2187-49e4-82c7-839909d10854", "name": "network-vif-deleted", "tag": "40819e72-6b92-48e6-8907-95585c9cb368"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:43.922488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0698277f-5214-4816-8a09-5f2f8f4853d5 req-d9859a78-23fe-449a-966d-4082f669c2a0 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:43.923047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0698277f-5214-4816-8a09-5f2f8f4853d5 req-d9859a78-23fe-449a-966d-4082f669c2a0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:43.923501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0698277f-5214-4816-8a09-5f2f8f4853d5 req-d9859a78-23fe-449a-966d-4082f669c2a0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:43.955988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0698277f-5214-4816-8a09-5f2f8f4853d5 req-d9859a78-23fe-449a-966d-4082f669c2a0 service nova] Creating event network-vif-deleted:40819e72-6b92-48e6-8907-95585c9cb368 for instance c7d122d8-2187-49e4-82c7-839909d10854 on hv-cinder-83602 Sep 07 07:56:43.970963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0698277f-5214-4816-8a09-5f2f8f4853d5 req-d9859a78-23fe-449a-966d-4082f669c2a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078832 Sep 07 07:56:43.975102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 100/190] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:56:44.094224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:44.104322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fa38635e-7ee5-46e9-89d4-f92eafa1ea7d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.383028 Sep 07 07:56:44.104901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 91/191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:43 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:44.142959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:44.144768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:44.151658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:44.152491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:44.153093 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:44.153953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:44.154557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:44.155131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:44.237704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:44.251634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4abedfb-7da2-456c-bcb4-e89a73e7029b tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1346 microversion: 2.1 time: 0.116171 Sep 07 07:56:44.254876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 101/192] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:44 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:45.134931 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:45.136322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:45.145201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:45.145931 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:45.146913 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:45.147914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:45.149864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:45.150707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:45.277851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:45.279066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:45.292021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:45.293466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:45.302411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:45.303769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:45.304305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:45.304748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:45.353694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:45.361074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:45.361860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:45.362473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:45.363151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lazy-loading 'fault' on Instance uuid c7d122d8-2187-49e4-82c7-839909d10854 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:56:45.378746 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c02d4c5f-8075-42cc-9edf-cc0200f92af2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.252045 Sep 07 07:56:45.383153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 92/193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:45 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:45.429180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4035909c0f414e5ca7fbab2caee29f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b093ac8c5cbc4bb6be326b2fb993a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:45.437486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9a049ef-0eac-4d7e-b85c-98e6a2f43007 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 200 len: 1351 microversion: 2.1 time: 0.163432 Sep 07 07:56:45.439728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 102/194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:45 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 1351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:46.423101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:46.426378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:46.433982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:46.434809 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:46.435627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:46.436435 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:46.437081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:46.437692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:46.475384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:46.476703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:46.490530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:46.491675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:46.492125 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:46.493574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:46.494199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:46.494829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:46.514793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] HTTP exception thrown: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Request method failure captured: Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 HTTP/1.1 Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5qkyR82YidYFWhZUfyA8TjaxOWzcZfrbepdwzj01w15phYxInDcwCb07r5BdgotCFNkde8DCNHrKBcDO1S0lGtnjG-0rseQLx3H0WQP0lrvaNT9xPyrjscGKD2q3lb7Jgw1L6qdlnR2f5skVCSnwXo0vQn_rX56QUZv2gUuZUFnNw Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:56:46.520386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b093ac8c5cbc4bb6be326b2fb993a76b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 4035909c0f414e5ca7fbab2caee29f4d Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.522023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'c7d122d8-2187-49e4-82c7-839909d10854'} Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:56:46.522745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.524270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.525794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Returning 404 to user: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:56:46.525794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e9f3d15-7bf2-4707-a622-44397732c910 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 404 len: 111 microversion: 2.1 time: 0.053096 Sep 07 07:56:46.525794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 103/195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:46 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 07:56:46.678470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:46.687412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2fb40a99-ce96-4550-b1db-0c331fdf711a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.278018 Sep 07 07:56:46.696853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 93/196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:46 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:46.701542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:46.703680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:46.715710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:46.716490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:46.717002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:46.717781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:46.718308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:46.718944 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:46.736131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] HTTP exception thrown: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Request method failure captured: Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854/os-volume_attachments HTTP/1.1 Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5qkyR82YidYFWhZUfyA8TjaxOWzcZfrbepdwzj01w15phYxInDcwCb07r5BdgotCFNkde8DCNHrKBcDO1S0lGtnjG-0rseQLx3H0WQP0lrvaNT9xPyrjscGKD2q3lb7Jgw1L6qdlnR2f5skVCSnwXo0vQn_rX56QUZv2gUuZUFnNw Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:56:46.738130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b093ac8c5cbc4bb6be326b2fb993a76b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 4035909c0f414e5ca7fbab2caee29f4d Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.739303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'server_id': 'c7d122d8-2187-49e4-82c7-839909d10854'} Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:56:46.740594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:46.742120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:46.744120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Returning 404 to user: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:56:46.745404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-718fecff-0a3a-4d73-8af2-bf13e7b9d62e tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047902 Sep 07 07:56:46.746040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 104/197] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:56:46 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 07:56:47.712790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:47.715304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:47.721475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:47.722192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:47.722622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:47.723774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:47.724858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:47.725734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:47.832653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-464a5e3e-03ef-4b27-a074-95b8411e72e1 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Action: 'create', calling method: .version_select at 0x7f831ecf4af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1619576350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtNhs5oOQynGivwj6slOhWGFOxSqOni22sOoYSnX6NY0Q0SwKglcNAXEGviFDBUKiCxgs+d13eJAIXUkR4QuJ8POJL1yZi67LPyR+2k1KSL5lVXL4et+xeZTLo3F0Z9Fg=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:47.864189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-464a5e3e-03ef-4b27-a074-95b8411e72e1 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Getting quotas for project 126a90736fb3438ab05ffeae4bafa7a1. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:56:47.868727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-464a5e3e-03ef-4b27-a074-95b8411e72e1 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Getting quotas for user f018f290f36f4121becdfcc2bc10827c and project 126a90736fb3438ab05ffeae4bafa7a1. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:56:47.887035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:47.895617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e50d14f4-eebb-4d61-ae3c-266b8d8fd576 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.187185 Sep 07 07:56:47.898101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 94/198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:47 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:47.919860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-464a5e3e-03ef-4b27-a074-95b8411e72e1 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.090902 Sep 07 07:56:47.920690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 105/199] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 07:56:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:56:48.025020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1029868008", "imageRef": "bdaa8156-c530-409e-a4e8-4215e69952ba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1619576350", "networks": [{"uuid": "420d544f-2dd9-4fa7-9680-73a4ab55792b"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:56:48.117289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:48.118129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:48.126631 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:48.127184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:48.127619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:48.128349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:48.128929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:48.129351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:48.145056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] HTTP exception thrown: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Request method failure captured: Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 HTTP/1.1 Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5qkyR82YidYFWhZUfyA8TjaxOWzcZfrbepdwzj01w15phYxInDcwCb07r5BdgotCFNkde8DCNHrKBcDO1S0lGtnjG-0rseQLx3H0WQP0lrvaNT9xPyrjscGKD2q3lb7Jgw1L6qdlnR2f5skVCSnwXo0vQn_rX56QUZv2gUuZUFnNw Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:56:48.150128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b093ac8c5cbc4bb6be326b2fb993a76b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 4035909c0f414e5ca7fbab2caee29f4d Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.156430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'c7d122d8-2187-49e4-82c7-839909d10854'} Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:56:48.157403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.158835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.160253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Returning 404 to user: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:56:48.160253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9fe7059e-92a6-47b4-939b-c0ce85420fd0 tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 404 len: 111 microversion: 2.1 time: 0.039404 Sep 07 07:56:48.160253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 106/200] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 07:56:48 2022] DELETE /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 07:56:48.167082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:48.167843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] [instance: c7d122d8-2187-49e4-82c7-839909d10854] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:48.174096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:48.174872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:48.175424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:48.176190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:48.176589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:48.177141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:48.191620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] HTTP exception thrown: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Request method failure captured: Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 HTTP/1.1 Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5qkyR82YidYFWhZUfyA8TjaxOWzcZfrbepdwzj01w15phYxInDcwCb07r5BdgotCFNkde8DCNHrKBcDO1S0lGtnjG-0rseQLx3H0WQP0lrvaNT9xPyrjscGKD2q3lb7Jgw1L6qdlnR2f5skVCSnwXo0vQn_rX56QUZv2gUuZUFnNw Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:56:48.193293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b093ac8c5cbc4bb6be326b2fb993a76b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b093ac8c5cbc4bb6be326b2fb993a76b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: b093ac8c5cbc4bb6be326b2fb993a76b Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-DeleteServersTestJSON-766754015 Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 4035909c0f414e5ca7fbab2caee29f4d Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-DeleteServersTestJSON-766754015-project Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.194532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'c7d122d8-2187-49e4-82c7-839909d10854'} Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:56:48.195257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. Sep 07 07:56:48.197367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:56:48.200843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] Returning 404 to user: Instance c7d122d8-2187-49e4-82c7-839909d10854 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:56:48.200843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2331b06d-a052-445e-b9d6-cca8ee5eb4ed tempest-DeleteServersTestJSON-766754015 tempest-DeleteServersTestJSON-766754015-project] 10.222.0.26 "GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854" status: 404 len: 111 microversion: 2.1 time: 0.038973 Sep 07 07:56:48.200843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 107/201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:48 2022] GET /compute/v2.1/servers/c7d122d8-2187-49e4-82c7-839909d10854 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 07:56:48.921285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:48.922645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:48.930681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:48.931419 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:48.931998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:48.932937 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:48.933388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:48.933962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:49.184319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:49.193844 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69d2f201-3484-456f-8b26-3a8dbb97aae2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.277148 Sep 07 07:56:49.194500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 108/202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:48 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:50.220113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:50.221720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:50.233094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:50.233593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:50.235347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:50.236321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:50.236920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:50.237482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:50.546493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:50.555224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37a20eb4-d0c3-4be1-b569-a8fc676c26f3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.341473 Sep 07 07:56:50.556024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 109/203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:50 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:51.219175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] validate_networks() for [('420d544f-2dd9-4fa7-9680-73a4ab55792b', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:56:51.500112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:51.579433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:51.580600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:51.590178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:51.592766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:51.593931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:51.596559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:51.597205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:51.598658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:51.801735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:56:51.802208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:56:51.803754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:56:51.804603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:56:51.805470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:56:51.816932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:51.817244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:51.817682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:51.824828 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:51.836775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:51.845153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c5826c2b-7450-45d7-a4a9-5a962a002fed tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.270133 Sep 07 07:56:51.845731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 110/204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:51 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:51.865887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:51.866401 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:51.946747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Getting quotas for project 126a90736fb3438ab05ffeae4bafa7a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:56:51.955772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Getting quotas for user f018f290f36f4121becdfcc2bc10827c and project 126a90736fb3438ab05ffeae4bafa7a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:56:51.975623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:56:51.978223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdaa8156-c530-409e-a4e8-4215e69952ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:56:52.047201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-525a8f4e-492a-4542-a6bb-95e6fd0e804e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.027337 Sep 07 07:56:52.055317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 95/205] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:56:52.063115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f1880d3-3d0f-4eaa-bde6-b9bf1aa4a000 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:52.064201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6f1880d3-3d0f-4eaa-bde6-b9bf1aa4a000 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:52.130175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6f1880d3-3d0f-4eaa-bde6-b9bf1aa4a000 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:52.143076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f1880d3-3d0f-4eaa-bde6-b9bf1aa4a000 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1259 microversion: 2.1 time: 0.087169 Sep 07 07:56:52.143791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 111/206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:52 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1259 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:52.877855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:52.878739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:52.887324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:52.889842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:52.890579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:52.892275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:52.892941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:52.893620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:53.169927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:53.171079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:53.186928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:53.193432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:53.194984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:53.196620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:53.197934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:53.199982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:53.253621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:53.263127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-00e856b9-f5ec-4434-b11f-5afe8c4b7428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.396194 Sep 07 07:56:53.302720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 96/207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:52 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:53.383950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:53.406359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6ba8b66a-01cb-49f0-9e3b-5bc39ac92c25 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1311 microversion: 2.1 time: 0.240800 Sep 07 07:56:53.408634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 112/208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:53 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:54.293594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:54.294201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:54.302769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:54.307081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:54.307081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:54.307869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:54.311644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:54.312100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:54.436334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:54.436953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:54.456386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:54.456386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:54.456386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:54.456386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:54.459675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:54.460518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:54.461174 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:54.564884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:54.570383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:54.579567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdabb29a-184c-41b3-af3b-a44b9fbe35af tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1317 microversion: 2.1 time: 0.150778 Sep 07 07:56:54.580620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 113/209] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:54 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:54.751984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:54.765599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-19685f5e-4971-4bbd-b306-c2c847fb9811 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.475553 Sep 07 07:56:54.782099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 97/210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:54 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:55.611835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:55.612546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:55.648491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:55.650538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:55.652316 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:55.657998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:55.660234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:55.663646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:55.793157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:55.794638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:55.815230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:55.815792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:55.817446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:55.820802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:55.823996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:55.827232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:55.966590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:55.975550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ad61edbf-8555-459e-80fd-f872177320cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.371679 Sep 07 07:56:55.986043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 114/211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:55 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:56.274754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:56.288854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b7ae8ede-d0c9-4e07-8f36-cf43e6ced1c3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.502333 Sep 07 07:56:56.290595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 98/212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:55 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:57.021262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:57.023600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:57.039111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:57.039880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:57.040578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:57.041519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:57.043003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:57.044669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:57.317298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:57.320278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:57.335107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:57.335598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:57.336230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:57.336927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:57.341239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:57.343138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:57.391554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:56:57.558858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:57.575429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fa4c7647-33db-4dcc-b405-02b289b9516e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.559027 Sep 07 07:56:57.601256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 115/213] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:57 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:57.679605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:57.696621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d79bb922-5ab8-4dbf-91f3-3b5ed085261a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.385756 Sep 07 07:56:57.698195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 99/214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:57 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:56:58.613711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:58.614685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:58.625055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:58.625932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:58.626754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:58.627677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:58.628363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:58.628992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:58.735211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:56:58.748956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:56:58.784424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:58.784975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:58.785518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:58.786579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:56:58.787229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:56:58.787739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:56:59.142427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:59.154607 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5acba862-fa99-4072-b3ac-f05e771967fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.433381 Sep 07 07:56:59.175135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 100/215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:58 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:56:59.199291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:56:59.226153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e9812c4-893b-4fce-88c9-7948af4ddcd5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.617209 Sep 07 07:56:59.230130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 116/216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:56:58 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:00.190606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:00.192029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:00.204170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:00.206689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:00.210312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:00.213051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:00.214476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:00.216676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:00.263626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:00.264286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:00.307051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:00.307781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:00.308865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:00.309593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:00.310204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:00.314265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:00.862276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:00.872906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:00.873805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d7926a86-ebcc-46ef-ae09-84bf6ebab6cf tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.621702 Sep 07 07:57:00.874408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 117/217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:00 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:00.889679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bf515c73-ab76-4dd6-bce1-5005baf611c0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.703562 Sep 07 07:57:00.891491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 101/218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:00 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:01.275831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-96386807-562f-4f9a-bab0-0ff0e917ee0d req-e54bcb57-4197-41c0-8d6b-a0d71c2cee74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3423c4e5-5e93-40e4-8c2a-0fd51ded639b", "tag": "fa535e7d-89c4-4809-ac24-7f795dbf04e8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:01.298956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-96386807-562f-4f9a-bab0-0ff0e917ee0d req-e54bcb57-4197-41c0-8d6b-a0d71c2cee74 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:01.299485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-96386807-562f-4f9a-bab0-0ff0e917ee0d req-e54bcb57-4197-41c0-8d6b-a0d71c2cee74 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:01.300379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-96386807-562f-4f9a-bab0-0ff0e917ee0d req-e54bcb57-4197-41c0-8d6b-a0d71c2cee74 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:01.334479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-96386807-562f-4f9a-bab0-0ff0e917ee0d req-e54bcb57-4197-41c0-8d6b-a0d71c2cee74 service nova] Creating event network-changed:fa535e7d-89c4-4809-ac24-7f795dbf04e8 for instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b on hv-cinder-83602 Sep 07 07:57:01.360982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-96386807-562f-4f9a-bab0-0ff0e917ee0d req-e54bcb57-4197-41c0-8d6b-a0d71c2cee74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090406 Sep 07 07:57:01.363214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 118/219] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:57:01.898908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:01.900149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:01.902279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:01.919799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:01.921047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:01.945920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:01.950587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:01.951222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:01.952215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:01.952848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:01.953470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:01.958180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:01.960847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:01.961665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:01.966301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:01.967033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:01.967526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:02.042516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:02.142668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:02.500110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:02.512652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ef90913f-1daf-4d21-9104-bbfab5b4e78b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.597541 Sep 07 07:57:02.525088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 119/220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:01 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:02.714472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:02.732405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6058afd2-98ce-4fb9-85a9-e0d17a57fa6e tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.838548 Sep 07 07:57:02.737800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 102/221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:01 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:03.556155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:03.557648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:03.571444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:03.574831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:03.576754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:03.579144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:03.581021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:03.581842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:03.765185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:03.765794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:03.783459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:03.786635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:03.787105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:03.794994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:03.796485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:03.798528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:04.137778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:04.147571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5908454f-c18c-4b3a-9e34-e811e6cf5dc1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.597862 Sep 07 07:57:04.160265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 120/222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:03 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:04.220693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:04.231853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1b6e352d-edf3-4731-a8a5-dd1c19f24c70 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.470956 Sep 07 07:57:04.232488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 103/223] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:03 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:04.434920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-452859fd-27bb-4a48-9701-608b10437958 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'create', calling method: .version_select at 0x7f831ec533a0>, body: {"keypair": {"name": "tempest-keypair-1486736810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0XZzSQg3E3NaBRubWIoSQV6SVasYkEAXZ2l2Yv8A3HUJI/PwDqv3BvAlGnEmwCQl9tvCoief1XxXafyDEB1iN+eeccvKGSO9pXzrUS5KRNb6SFYRSPnCNT6KzWD5puHw=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:04.452394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-452859fd-27bb-4a48-9701-608b10437958 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for project 3264396aada44ba89f39cfe0776e183e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:57:04.456657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-452859fd-27bb-4a48-9701-608b10437958 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for user 55b97e954da94f909f8f5ffff515509e and project 3264396aada44ba89f39cfe0776e183e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:57:04.480755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-452859fd-27bb-4a48-9701-608b10437958 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200953 Sep 07 07:57:04.481359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 121/224] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 07:57:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:05.179579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:05.183359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:05.225367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:05.226481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:05.227726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:05.229487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:05.232833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:05.233591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:05.259804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:05.260732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:05.305371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:05.305371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:05.305371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:05.307936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:05.309385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:05.311508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:05.718139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:05.730797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dfb2c446-baa0-463e-a8f4-4fa9bb6a4fdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.554775 Sep 07 07:57:05.732714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 104/225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:05 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:06.420591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:06.429007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ee4ef7f-4b22-4825-a434-230f748adad5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 1.177073 Sep 07 07:57:06.432214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 122/226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:05 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:06.759741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:06.760584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:06.776429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:06.777329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:06.777959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:06.778873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:06.780931 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:06.784585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:07.004286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:07.013921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b8ebe369-1457-41c6-8e31-411024a75a9a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.257978 Sep 07 07:57:07.014660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 105/227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:06 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:07.319275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1252172611", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26a64bc8-5c6b-4a41-8bf0-7f007c3b1bce"}], "security_groups": [{"name": "tempest-securitygroup--569844281"}], "key_name": "tempest-keypair-1486736810", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:07.457917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] validate_networks() for [('26a64bc8-5c6b-4a41-8bf0-7f007c3b1bce', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:57:07.459903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:07.460747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:07.466853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:07.467341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:07.467837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:07.468490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:07.468994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:07.469413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:07.629756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:07.642071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d601f934-9584-4078-84d1-9843264edf65 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.186235 Sep 07 07:57:07.643057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 106/228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:07 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:07.915767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:57:07.916390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:57:07.917160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:57:07.918877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:57:07.919298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:57:07.928950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:07.929623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:07.930244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:07.931018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:07.931614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:07.932019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:07.950031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for project 3264396aada44ba89f39cfe0776e183e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:57:07.954173 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for user 55b97e954da94f909f8f5ffff515509e and project 3264396aada44ba89f39cfe0776e183e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:57:07.966293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:57:07.969324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:57:08.038626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:08.039385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:08.070159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:08.070790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:08.071334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:08.072414 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:08.072798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:08.073326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:08.124234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3236a102-957b-4d55-a542-fd0757823793 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.810478 Sep 07 07:57:08.125315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 123/229] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:57:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:57:08.149033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78327ddc-68e4-4525-b339-84ae2ba3e870 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:08.153351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78327ddc-68e4-4525-b339-84ae2ba3e870 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:08.248391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-78327ddc-68e4-4525-b339-84ae2ba3e870 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:08.259251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78327ddc-68e4-4525-b339-84ae2ba3e870 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1238 microversion: 2.1 time: 0.120263 Sep 07 07:57:08.272856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 124/230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:08 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1238 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:08.483892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:08.492376 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c087693c-bfd1-47dd-a4a1-fd89d91413c4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.458155 Sep 07 07:57:08.495446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 107/231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:08 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:08.666512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:08.667677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:08.674462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:08.675163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:08.675771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:08.676535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:08.677139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:08.677713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:08.838771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:08.850343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e965f1f-1340-4b47-8cf4-c640e09b4dba tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.187651 Sep 07 07:57:08.851044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 125/232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:08 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:09.282887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:09.283701 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:09.295327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:09.295818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:09.299302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:09.321097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:09.321756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:09.323192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:09.414314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:09.433908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aab71c6a-0bd7-47bd-a664-92e0fa75ad41 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1234 microversion: 2.1 time: 0.154813 Sep 07 07:57:09.444937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 108/233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:09 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1234 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:09.520924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:09.521956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:09.532709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:09.533213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:09.533655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:09.534381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:09.534825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:09.535252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:09.735962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:09.744311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91ab6c07-d739-4513-b7e3-1d0cd7afce75 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1521 microversion: 2.1 time: 0.230344 Sep 07 07:57:09.745186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 126/234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:09 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:09.873070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:09.873672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:09.880531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:09.881049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:09.881475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:09.882154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:09.882630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:09.883053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:10.015659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:10.023891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c94dff05-a81a-4fab-a587-1638a995f69a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.154408 Sep 07 07:57:10.024574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 109/235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:09 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:10.457277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:10.458605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:10.464485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:10.464961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:10.465393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:10.466069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:10.466546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:10.466967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:10.529742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:10.537537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5168821b-415a-4f20-b2d8-0598bc421555 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1290 microversion: 2.1 time: 0.084018 Sep 07 07:57:10.538092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 127/236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:10 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:10.768780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:10.769389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:10.778274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:10.778974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:10.779389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:10.780102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:10.780571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:10.781000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:10.931965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:10.941108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-05573303-126e-4c7a-89bc-64cf97da4ad4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1501 microversion: 2.1 time: 0.175965 Sep 07 07:57:10.941776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 110/237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:10 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:10.963816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:10.964567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:10.976279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:10.976279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:10.976279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:10.976279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:10.976930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:10.976930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:11.046144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:11.046772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:11.053108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:11.053709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:11.054215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:11.054979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:11.055531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:11.056061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:11.112546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:11.121334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c2296245-20fc-46ed-a983-7bef9a62e867 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1517 microversion: 2.1 time: 0.161319 Sep 07 07:57:11.122003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 128/238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:10 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:11.189449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:11.197481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-069d33df-6579-45e1-9217-85f30945ee26 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.155313 Sep 07 07:57:11.198051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 111/239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:11 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:11.560410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:11.561034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:11.567287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:11.567922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:11.568386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:11.569079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:11.569538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:11.569963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:11.632762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:11.640260 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69e87b72-aa8c-4e55-b4bc-560a91875d06 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1290 microversion: 2.1 time: 0.083857 Sep 07 07:57:11.640823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 129/240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:11 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:12.220005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:12.220675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:12.227121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:12.227633 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:12.228161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:12.228788 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:12.229240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:12.229659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:12.359606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:12.368015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-249127a6-3b6f-43ed-8640-2d0ce3675449 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.151875 Sep 07 07:57:12.368608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 112/241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:12 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:12.662980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:12.663506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:12.670113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:12.670605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:12.671047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:12.671738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:12.672229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:12.672658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:12.733418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:12.741117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eac5dfb1-9418-4e33-b94b-935ceb88c332 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1290 microversion: 2.1 time: 0.082196 Sep 07 07:57:12.741677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 130/242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:12 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:13.391075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:13.391750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:13.397918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:13.398400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:13.398829 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:13.399516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:13.399966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:13.400425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:13.603915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:13.615857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-49cf46a4-3b43-4bae-b494-c61a6904ad23 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.228532 Sep 07 07:57:13.616687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 113/243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:13 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:13.764391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:13.765128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:13.772631 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:13.773124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:13.773557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:13.774254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:13.774705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:13.775124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:13.843544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:13.852779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-878c707d-851b-4cc0-852f-cae9a3b67a01 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1296 microversion: 2.1 time: 0.092304 Sep 07 07:57:13.853472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 131/244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:13 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:14.648862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:14.649472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:14.655394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:14.655884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:14.656354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:14.657045 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:14.657503 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:14.657925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:14.877592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:14.878392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:14.885455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:14.885931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:14.886527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:14.887217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:14.887663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:14.888270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:14.902333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:14.909992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8fcd390a-1c45-47a3-872c-13e24e47a0e4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.265651 Sep 07 07:57:14.910861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 114/245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:14 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:15.045644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:15.057678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-639b7e20-5bd3-441f-821a-cd9e9a2e0221 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.183770 Sep 07 07:57:15.058255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 132/246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:14 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:15.306762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-95ca55ec-0c71-4796-baa8-9758dc988d01 req-a3a89de6-698b-4f19-9dc1-66dbb8dbcdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3423c4e5-5e93-40e4-8c2a-0fd51ded639b", "name": "network-vif-plugged", "status": "completed", "tag": "fa535e7d-89c4-4809-ac24-7f795dbf04e8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:15.324515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-95ca55ec-0c71-4796-baa8-9758dc988d01 req-a3a89de6-698b-4f19-9dc1-66dbb8dbcdc0 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.325350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-95ca55ec-0c71-4796-baa8-9758dc988d01 req-a3a89de6-698b-4f19-9dc1-66dbb8dbcdc0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.326092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-95ca55ec-0c71-4796-baa8-9758dc988d01 req-a3a89de6-698b-4f19-9dc1-66dbb8dbcdc0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:15.332286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-92308a87-64d8-4870-8339-6f2dd7d1e954 req-86100a6d-3396-43db-b400-aab35ad60ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e625ca1a-4906-44bc-afe5-092b2f95c4d9", "tag": "e9177b89-1981-44ee-94b6-ba5c779c2297"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:15.339966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-95ca55ec-0c71-4796-baa8-9758dc988d01 req-a3a89de6-698b-4f19-9dc1-66dbb8dbcdc0 service nova] Creating event network-vif-plugged:fa535e7d-89c4-4809-ac24-7f795dbf04e8 for instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b on hv-cinder-83602 Sep 07 07:57:15.347252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-95ca55ec-0c71-4796-baa8-9758dc988d01 req-a3a89de6-698b-4f19-9dc1-66dbb8dbcdc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044442 Sep 07 07:57:15.349532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 115/247] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:15.366260 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-92308a87-64d8-4870-8339-6f2dd7d1e954 req-86100a6d-3396-43db-b400-aab35ad60ac5 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.367099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-92308a87-64d8-4870-8339-6f2dd7d1e954 req-86100a6d-3396-43db-b400-aab35ad60ac5 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.367642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-92308a87-64d8-4870-8339-6f2dd7d1e954 req-86100a6d-3396-43db-b400-aab35ad60ac5 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:15.405861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-92308a87-64d8-4870-8339-6f2dd7d1e954 req-86100a6d-3396-43db-b400-aab35ad60ac5 service nova] Creating event network-changed:e9177b89-1981-44ee-94b6-ba5c779c2297 for instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 on hv-cinder-83602 Sep 07 07:57:15.421852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-92308a87-64d8-4870-8339-6f2dd7d1e954 req-86100a6d-3396-43db-b400-aab35ad60ac5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093099 Sep 07 07:57:15.422504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 133/248] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:15.695321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:15.698210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:15.703845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.704376 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.705005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:15.705700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.706323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.707010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:15.732739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lazy-loading 'flavor' on Instance uuid ee87953e-ba27-4c28-b0db-0dfa81b496e6 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:57:15.737183 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:15.823070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-354bc50a-6a83-4dd1-9572-826ab02ca879 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6/action" status: 200 len: 32 microversion: 2.1 time: 0.132754 Sep 07 07:57:15.823926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 116/249] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:57:15 2022] POST /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6/action => generated 32 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 07:57:15.835686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:15.836539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:15.842999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.843580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.844323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:15.845158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.845709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.846208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:15.869307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:15.933610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:15.934538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:15.941693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.942733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.943491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:15.949603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:15.950088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:15.950525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:16.015037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:16.024632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b27ee52e-d2b9-4b83-92bb-cf878be9fc7e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.194860 Sep 07 07:57:16.025713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 134/250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:15 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:16.086352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:16.087446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:16.093927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:16.094752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:16.095453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:16.096573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:16.097457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:16.098592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:16.110489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:16.124474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b4ae2d7-e1a0-4829-9c4c-bb81ba1ba2b6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.195188 Sep 07 07:57:16.125578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 117/251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:15 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:16.296512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:16.305604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-89d229a0-adde-4e0d-b559-36cfed93a83d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.223901 Sep 07 07:57:16.306317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 135/252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:16 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:17.055543 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:17.055543 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:17.057420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:17.058023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:17.058327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:17.059017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:17.059468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:17.059887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:17.150517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:17.151255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:17.158054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:17.158537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:17.158967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:17.159651 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:17.160294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:17.161385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:17.198933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:17.208189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fcd6cdf9-188f-44b4-bb6d-a58bfc76a883 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.162091 Sep 07 07:57:17.208743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 118/253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:17 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:17.302959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:17.310686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f0193547-3e6c-4de7-b499-934cb952d335 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1359 microversion: 2.1 time: 0.163936 Sep 07 07:57:17.311246 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 136/254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:17 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:17.328929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:17.329638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:17.336539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:17.336973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:17.340419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:17.341175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:17.341646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:17.342078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:17.478772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:17.487084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9a268bb3-7b20-4a16-a7b8-e0191a34500d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.161584 Sep 07 07:57:17.487084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 119/255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:17 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:18.230935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:18.231625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:18.233537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:18.239394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.239872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.240349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.241036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.241491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.241909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.257175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=12 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:18.333659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:18.334263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:18.340640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.341129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.341560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.342246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.342698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.343115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.373009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:18.382312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f6a123a-aa70-4983-9d81-4ce01e36b092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.155347 Sep 07 07:57:18.382992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 137/256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:18 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:18.509749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:18.510463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:18.516537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.517090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.517591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.518607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.519279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.520476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.601923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:18.609811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8fc42f9c-92e7-4399-9661-a9ff965ba750 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1548 microversion: 2.1 time: 0.279865 Sep 07 07:57:18.622240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 120/257] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:18 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1548 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:18.636625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:18.637399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:18.643458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.643955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.644432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.646081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.646403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.647136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.665773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:18.674344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3117b2f9-8229-4c2d-ade6-0cda29e89bbf tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.168357 Sep 07 07:57:18.674922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 138/258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:18 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:18.777836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:18.778338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:18.784297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.784788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.785231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.787015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.787476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.787906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.817863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eba1faba-1531-4b96-8435-7e22e8db0e3d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/ips" status: 200 len: 150 microversion: 2.1 time: 0.043586 Sep 07 07:57:18.818623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 139/259] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 07:57:18 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:57:18.933889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:18.944209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ae5c4989-d71a-4f49-a206-02ba3bee6694 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1548 microversion: 2.1 time: 0.312621 Sep 07 07:57:18.944996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 121/260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:18 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1548 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:18.968632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:18.974413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:18.975907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Searching by: {'deleted': False, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1'} {{(pid=120494) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 07:57:18.982503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.983029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.983664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:18.984611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:18.985109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:18.985757 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:19.251400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.multi_cell_list [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 07:57:19.344613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-25a7e76e-14c6-4ca9-ab96-1326e11144c5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.380758 Sep 07 07:57:19.345112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 140/261] 10.222.0.26 () {58 vars in 1125 bytes} [Wed Sep 7 07:57:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:19.356969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:19.357577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:19.364185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:19.364678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:19.365143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:19.365827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:19.366275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:19.366692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:19.405162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:19.405767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:19.417800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:19.417800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:19.417800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:19.417800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:19.418224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:19.418224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:19.497563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:19.505404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-07263680-17cd-4345-b870-4d4f5c49aec9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1548 microversion: 2.1 time: 0.152220 Sep 07 07:57:19.505973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 122/262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:19 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:19.545554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:19.553723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6dde521c-ee28-464a-a1f5-2d1c40f4f2b2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.152345 Sep 07 07:57:19.554325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 141/263] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:19 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:19.697467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:19.698064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:19.704013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:19.704515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:19.704949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:19.705633 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:19.706083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:19.706597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:19.870345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:19.877995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d01c027e-b5d5-4ccf-9d70-fade3ee31bd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.184554 Sep 07 07:57:19.878595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 123/264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:19 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:20.578738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:20.580345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:20.589098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:20.589771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:20.590861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:20.592191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:20.593134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:20.593711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:20.736526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:20.744464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8741e29-c709-4692-84bd-d74d17bf3e56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.170957 Sep 07 07:57:20.745051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 142/265] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:20 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:20.901916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:20.902530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:20.908636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:20.909114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:20.909555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:20.910237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:20.910693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:20.911120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:21.042570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:21.050109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-369ce90c-1590-4581-9542-097eb3bca700 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.151996 Sep 07 07:57:21.050663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 124/266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:20 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:21.768775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:21.769343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:21.776578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:21.777065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:21.777493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:21.778193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:21.778645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:21.779065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:21.932352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:21.943553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-15eeac96-eaaf-4441-8e7d-1191eb4f244e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.178038 Sep 07 07:57:21.943885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 143/267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:21 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:22.073225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:22.073855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:22.076010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:22.081408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:22.081900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:22.082932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:22.083626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:22.084108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:22.084525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:22.218755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:22.227334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d6fe229a-ce8b-4d2f-881d-7090b9433ade tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.158051 Sep 07 07:57:22.227892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 125/268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:22 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:22.285994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:22.286383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:22.292477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:22.292961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:22.293389 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:22.294073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:22.294522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:22.294935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:22.318888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2c25a98-8c8a-48ea-b523-393e6918ce1f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/ips" status: 200 len: 152 microversion: 2.20 time: 0.037471 Sep 07 07:57:22.319463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 144/269] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Sep 7 07:57:22 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:57:22.967110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:22.967761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:22.976394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:22.976889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:22.978307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:22.979028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:22.979539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:22.979966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.120841 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:23.129817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3c8f2c45-3322-4b57-a3a7-18a49c5a1d7c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.166417 Sep 07 07:57:23.130599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 126/270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:22 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:23.180731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af8660a1-280a-4df6-8432-95f4776c5ab2"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:23.183062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:23.189464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:23.189943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:23.190387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.191340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:23.192331 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:23.192762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.252307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:23.253261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:23.263014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:23.263772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:23.264478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.265399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:23.265967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:23.266690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.466122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:23.477235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7a4e4c6a-4111-4e4d-8a96-3fc54108e129 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.229609 Sep 07 07:57:23.478473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 127/271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:23 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:23.485131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47af907f-25c4-4f52-a9ea-9feec8d5313d"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:23.488120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:23.497368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:23.498333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:23.498944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.499941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:23.500515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:23.501531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.620341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9fb6cc56-019a-40d9-8aaf-295aa0a5f0e5 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443594 Sep 07 07:57:23.628436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 145/272] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 07:57:23 2022] POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:23.714564 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-68af2386-93f5-4d26-8a3d-244c5ea59f1a req-821a15c6-5375-4be7-85d9-890363f8bf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e625ca1a-4906-44bc-afe5-092b2f95c4d9", "name": "network-vif-plugged", "status": "completed", "tag": "e9177b89-1981-44ee-94b6-ba5c779c2297"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:23.736603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-68af2386-93f5-4d26-8a3d-244c5ea59f1a req-821a15c6-5375-4be7-85d9-890363f8bf01 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:23.737656 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-68af2386-93f5-4d26-8a3d-244c5ea59f1a req-821a15c6-5375-4be7-85d9-890363f8bf01 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:23.738169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-68af2386-93f5-4d26-8a3d-244c5ea59f1a req-821a15c6-5375-4be7-85d9-890363f8bf01 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:23.774950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-68af2386-93f5-4d26-8a3d-244c5ea59f1a req-821a15c6-5375-4be7-85d9-890363f8bf01 service nova] Creating event network-vif-plugged:e9177b89-1981-44ee-94b6-ba5c779c2297 for instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 on hv-cinder-83602 Sep 07 07:57:23.782095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-68af2386-93f5-4d26-8a3d-244c5ea59f1a req-821a15c6-5375-4be7-85d9-890363f8bf01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085574 Sep 07 07:57:23.782865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 146/273] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:57:24.020311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ff8a9484-fccc-4ed6-8c94-5707a3cc629a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539632 Sep 07 07:57:24.021276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 128/274] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 07:57:23 2022] POST /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:24.154670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:24.155453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:24.163858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:24.164431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:24.164910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:24.165688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:24.166341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:24.167005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:24.305152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:24.313605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-34a8cb15-b3b4-400c-bc16-40d5c23fac87 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.163615 Sep 07 07:57:24.314260 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 147/275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:24 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:24.501750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:24.502391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:24.508754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:24.509232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:24.509665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:24.510349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:24.510798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:24.511236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:24.646369 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:24.654002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c5057100-135f-4ca1-9b44-71223762134f tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1363 microversion: 2.1 time: 0.157013 Sep 07 07:57:24.654560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 129/276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:24 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:24.872386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:24.873409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:24.876401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:24.883417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:24.883994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:24.884623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:24.885282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:24.885914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:24.886399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:24.915673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lazy-loading 'flavor' on Instance uuid 86bf06d0-30dc-4a08-94a4-bac302f07efb {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:57:25.037283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:25.166293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b388598c-a246-451d-8aa8-be9da1e27c93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/action" status: 202 len: 0 microversion: 2.20 time: 0.299388 Sep 07 07:57:25.166846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 148/277] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Sep 7 07:57:24 2022] POST /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 07:57:25.175047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:25.175658 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:25.182831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.183334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.183759 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.184534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.184989 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.185492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.189826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:25.339452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:25.340890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:25.347755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.348277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.348915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.349670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.350200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.350634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.363777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:25.373977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:25.375825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:25.377884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9f2936ea-2238-442f-a4be-82d7a06d00b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.206142 Sep 07 07:57:25.379570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 130/278] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:25 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:25.501455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:25.509763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01217c78-5338-49bc-a8a4-b431449c9714 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.174674 Sep 07 07:57:25.510709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 149/279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:25 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:25.676203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:25.676842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:25.682943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.683424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.683857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.684568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.685022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.685446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.835203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:25.844305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ad81f7f1-a132-4804-9859-1cd4247b0b15 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1550 microversion: 2.1 time: 0.171857 Sep 07 07:57:25.844871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 131/280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:25 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1550 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:25.868362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:25.869383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:25.878387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.879023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.879732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.880687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:25.881168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:25.881602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:25.967270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ea0a6f0-e212-437c-9955-c119bb116ec8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103344 Sep 07 07:57:25.967918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 150/281] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 07:57:25 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:57:26.405572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:26.406188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:26.412979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:26.421523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:26.421965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:26.422916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:26.423378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:26.424160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:26.533069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:26.533677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:26.540943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:26.541580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:26.542078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:26.543010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:26.543529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:26.544040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:26.664979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:26.674998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:26.676715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:26.677971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b222a579-4594-4534-a90e-89f8e282cadf tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.276657 Sep 07 07:57:26.678589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 132/282] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:26 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:26.877539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:26.887245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be7b27d5-e931-47ec-b35a-96abc0b51518 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.358089 Sep 07 07:57:26.887830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 151/283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:26 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:27.553014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-4ed69b02-6be6-440d-8644-a46135001c05 req-6baab6f6-4c46-48d2-b11a-15bcc23410d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e625ca1a-4906-44bc-afe5-092b2f95c4d9", "tag": "e9177b89-1981-44ee-94b6-ba5c779c2297"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:27.571364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4ed69b02-6be6-440d-8644-a46135001c05 req-6baab6f6-4c46-48d2-b11a-15bcc23410d8 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:27.572755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4ed69b02-6be6-440d-8644-a46135001c05 req-6baab6f6-4c46-48d2-b11a-15bcc23410d8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:27.573339 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4ed69b02-6be6-440d-8644-a46135001c05 req-6baab6f6-4c46-48d2-b11a-15bcc23410d8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:27.586696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-4ed69b02-6be6-440d-8644-a46135001c05 req-6baab6f6-4c46-48d2-b11a-15bcc23410d8 service nova] Creating event network-changed:e9177b89-1981-44ee-94b6-ba5c779c2297 for instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 on hv-cinder-83602 Sep 07 07:57:27.593274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-4ed69b02-6be6-440d-8644-a46135001c05 req-6baab6f6-4c46-48d2-b11a-15bcc23410d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046039 Sep 07 07:57:27.594083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 133/284] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:27.703417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:27.704013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:27.713568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:27.714065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:27.714504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:27.715231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:27.715689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:27.716138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:27.911384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:27.912697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:27.922627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:27.923381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:27.923900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:27.924856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:27.925395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:27.926636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:28.005578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:28.023054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:28.024696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:28.026307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ce86f6e-9545-455e-8db1-4b9579f3ac3b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.326694 Sep 07 07:57:28.026957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 152/285] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:27 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:57:28.171907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:28.183651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-34d99b93-871b-4fe1-8706-a51913a2c19e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.276420 Sep 07 07:57:28.184844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 134/286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:27 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:29.055896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:29.057469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:29.063796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:29.080781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:29.081355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:29.081873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:29.082790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:29.083260 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:29.083689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:29.208194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:29.209313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:29.217827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:29.218672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:29.219354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:29.220512 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:29.221138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:29.221744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:29.524761 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:29.544288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:29.546075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:29.547842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24f682f3-fbf3-4b63-ac1e-27844352f15f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.498928 Sep 07 07:57:29.561847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 153/287] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:29 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:29.862589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:29.870557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5a0ef655-0b13-49ed-823f-c9395a97ba9d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.666174 Sep 07 07:57:29.871321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 135/288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:29 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:30.583290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:30.587206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:30.595681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:30.596499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:30.597126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:30.598756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:30.599605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:30.600511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:30.897666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:30.898283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:30.912956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:30.913688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:30.914271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:30.915167 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:30.915882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:30.916486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:31.033486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:31.049375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:31.053151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:31.054423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-99d1b34d-474a-4ca4-87e1-aff6e2e898b0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.478810 Sep 07 07:57:31.062236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 154/289] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:30 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:31.128887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:31.138345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c7629bab-062c-47fe-98e5-3641700cd0cd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.246823 Sep 07 07:57:31.139526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 136/290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:30 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:32.088387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:32.089696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:32.096781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:32.098170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:32.098786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:32.099777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:32.100421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:32.100987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:32.163621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:32.164355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:32.171131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:32.171627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:32.172064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:32.177337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:32.178135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:32.178819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:32.346403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:32.362358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:32.364668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:32.365919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b964c123-a0ee-47ba-a359-c95537da58eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.281727 Sep 07 07:57:32.385007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 155/291] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:32 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:32.439530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:32.448797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7edf6209-bf9d-4b18-a025-c528eb7d6011 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.289634 Sep 07 07:57:32.449661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 137/292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:32 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:32.567398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:32.568381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:32.574592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:32.575121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:32.575745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:32.576678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:32.577347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:32.577837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:32.740956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:32.750537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf427e5c-7e5e-4d3a-baa3-cf905b88bdf3 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1594 microversion: 2.1 time: 0.187747 Sep 07 07:57:32.751103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 156/293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:32 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1594 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:33.391072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:33.392308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:33.399379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:33.400128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:33.400577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:33.401290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:33.401753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:33.402181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:33.479323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:33.482036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:33.499535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:33.500382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:33.501400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:33.502353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:33.502820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:33.503386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:33.638679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:33.647771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:33.650458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:33.653279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fe6ea4d6-4fde-483f-9b73-0799d4f9d3d6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.266067 Sep 07 07:57:33.654263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 138/294] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:33 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:33.774429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:33.787758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdf5927e-32b5-4686-971e-0635c5d722fd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.316569 Sep 07 07:57:33.788404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 157/295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:33 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:34.684479 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:34.685715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:34.695097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:34.698961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:34.704855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:34.705869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:34.706767 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:34.709399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:34.823590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:34.825865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:34.842722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:34.843929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:34.846141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:34.848262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:34.850528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:34.852178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:35.139091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:35.151907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:35.153691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:35.161681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-df471a7e-eeb2-4750-bd04-2d75a5fcec8f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.481089 Sep 07 07:57:35.172765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 139/296] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:34 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:35.262751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:35.274794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c795660-62f1-475f-b182-bff77a192748 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.465663 Sep 07 07:57:35.275927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 158/297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:34 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:35.343732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-5a5b37a5-b25e-41bf-8025-f12b4245bd2a req-4b8a3f4e-e3d0-4da7-a88a-fb9f6b3af1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3423c4e5-5e93-40e4-8c2a-0fd51ded639b", "tag": "fa535e7d-89c4-4809-ac24-7f795dbf04e8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:35.365833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5a5b37a5-b25e-41bf-8025-f12b4245bd2a req-4b8a3f4e-e3d0-4da7-a88a-fb9f6b3af1f8 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:35.366318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5a5b37a5-b25e-41bf-8025-f12b4245bd2a req-4b8a3f4e-e3d0-4da7-a88a-fb9f6b3af1f8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:35.366754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5a5b37a5-b25e-41bf-8025-f12b4245bd2a req-4b8a3f4e-e3d0-4da7-a88a-fb9f6b3af1f8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:35.391771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-5a5b37a5-b25e-41bf-8025-f12b4245bd2a req-4b8a3f4e-e3d0-4da7-a88a-fb9f6b3af1f8 service nova] Creating event network-changed:fa535e7d-89c4-4809-ac24-7f795dbf04e8 for instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b on hv-cinder-83602 Sep 07 07:57:35.407855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-5a5b37a5-b25e-41bf-8025-f12b4245bd2a req-4b8a3f4e-e3d0-4da7-a88a-fb9f6b3af1f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067284 Sep 07 07:57:35.408486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 140/298] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:36.207667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:36.209092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:36.243543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:36.245897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:36.247166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:36.249239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:36.254397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:36.255254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:36.305707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:36.306724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:36.324012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:36.324798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:36.327589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:36.328533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:36.331272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:36.332205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:36.536554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:36.550722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:36.556047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:36.559183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7e57b86-70d9-43a6-9e80-182f551b996e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1745 microversion: 2.20 time: 0.376024 Sep 07 07:57:36.576581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 159/299] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:36 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1745 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:36.727217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:36.744172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9872e776-c771-4de2-a105-0282dbb44b83 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.444281 Sep 07 07:57:36.745378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 141/300] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:36 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:36.951467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-447412337"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:36.952016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:36.961890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:36.962395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:36.962836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:36.963558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:36.964016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:36.964474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:37.587499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:37.588914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:37.596206 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:37.596937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:37.597864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:37.599223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:37.599949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:37.600449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:37.781305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.network.security_group_api [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Adding security group 6d73b26c-1131-4271-97d7-f12767c82c80 to port fa535e7d-89c4-4809-ac24-7f795dbf04e8 Sep 07 07:57:37.795852 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:37.813817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:37.818330 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:37.820588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7e66881a-a73f-4932-be6c-b2ab946e381f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1745 microversion: 2.20 time: 0.236162 Sep 07 07:57:37.821630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 142/301] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:37 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1745 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:57:37.827101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:37.827904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:37.835550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:37.836362 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:37.836794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:37.837491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:37.837987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:37.838353 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:37.992346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:38.007968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85608de4-a9d2-49bd-be10-96c2c316340c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.184858 Sep 07 07:57:38.009010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 143/302] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:37 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:38.502055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08b5eaa9-0e35-4bc5-9749-fc091728702a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/action" status: 202 len: 0 microversion: 2.1 time: 1.554427 Sep 07 07:57:38.503729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 160/303] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:57:36 2022] POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/action => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:57:38.512365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:38.512587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-083d535d-5b5a-47bd-b095-bf551b816e21 req-f7da86c5-6ad6-465f-a8e5-721a5d283e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3423c4e5-5e93-40e4-8c2a-0fd51ded639b", "tag": "fa535e7d-89c4-4809-ac24-7f795dbf04e8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:38.513462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:38.520915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:38.521837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:38.523178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:38.524143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:38.524813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:38.525440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:38.535802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-083d535d-5b5a-47bd-b095-bf551b816e21 req-f7da86c5-6ad6-465f-a8e5-721a5d283e97 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:38.539195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-083d535d-5b5a-47bd-b095-bf551b816e21 req-f7da86c5-6ad6-465f-a8e5-721a5d283e97 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:38.539757 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-083d535d-5b5a-47bd-b095-bf551b816e21 req-f7da86c5-6ad6-465f-a8e5-721a5d283e97 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:38.562770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-083d535d-5b5a-47bd-b095-bf551b816e21 req-f7da86c5-6ad6-465f-a8e5-721a5d283e97 service nova] Creating event network-changed:fa535e7d-89c4-4809-ac24-7f795dbf04e8 for instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b on hv-cinder-83602 Sep 07 07:57:38.577889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-083d535d-5b5a-47bd-b095-bf551b816e21 req-f7da86c5-6ad6-465f-a8e5-721a5d283e97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069000 Sep 07 07:57:38.578812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 161/304] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:38.747854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:38.759571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fe45925a-2b3f-4fc0-9140-36ea1f195b45 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1759 microversion: 2.1 time: 0.251348 Sep 07 07:57:38.760542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 144/305] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:38 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1759 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:38.847888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:38.849394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:38.857843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:38.860868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:38.861696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:38.862655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:38.863318 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:38.864067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:39.031697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:39.032368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:39.047853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:39.048780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:39.050099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:39.052226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:39.053329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:39.054011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:39.240154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:39.262204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:39.265315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:39.268691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e41a7b33-f600-42af-9a69-a4ebdb4cbaae tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1745 microversion: 2.20 time: 0.425378 Sep 07 07:57:39.271510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 162/306] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:38 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1745 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:39.343561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:39.354900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3a96a1de-e9df-4c2e-ac91-ae7a5d2e0858 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.327311 Sep 07 07:57:39.363531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 145/307] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:39 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:39.504552 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f1b064d-d8f2-40ac-bf03-546d1d06a44e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: .version_select at 0x7f831eaa3280>, body: {"keypair": {"name": "tempest-keypair-89093674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuhLS2B8IYZocTcg6NuRepjQEpiIJdd5FOIc+3TeQJmKjAUNez2+9fPry195FhABrRtQnIyt0milWzZkCi28ylzReSzYE+1zt8R2OngJYeDJzJBBvFHWavwUODrRvbH8Q=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:39.539991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-1f1b064d-d8f2-40ac-bf03-546d1d06a44e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:57:39.545058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-1f1b064d-d8f2-40ac-bf03-546d1d06a44e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:57:39.589836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f1b064d-d8f2-40ac-bf03-546d1d06a44e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.095710 Sep 07 07:57:39.598784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 163/308] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 07:57:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:40.298277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:40.299662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:40.318066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:40.320862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:40.321488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:40.324494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:40.325145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:40.326413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:40.406783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:40.408259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:40.424430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:40.425565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:40.428954 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:40.430646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:40.431905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:40.434979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:40.683576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:40.693761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:40.712107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:40.713579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-735e8f92-0386-4b1d-9ac9-11a1d0fea6b5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.422032 Sep 07 07:57:40.714297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 146/309] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:40 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:40.772594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:40.796930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4e57948-57ec-42c2-8a33-cad8800ad7fb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.406820 Sep 07 07:57:40.813475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 164/310] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:40 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:41.221327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-32e67c85-277d-4fd1-b09d-fcbb5ae69a45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Action: 'create', calling method: .version_select at 0x7f831ec5ec10>, body: {"keypair": {"name": "tempest-TestShelveInstance-629093183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnm1gx4p+5svyn2A9a1svXUSyXYHmwIM5IT5J91LfryK5M+puyA+aiMzQGmtjMbDQgSpN98VYuUJPrKYyD9FjXUDowJSl+vFlgjUT+Yt86FG1ZKZYj4KtiFbgDGYwcQ6A=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:41.244782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-32e67c85-277d-4fd1-b09d-fcbb5ae69a45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Getting quotas for project 53d04fe2eaaf43fc82d82f344faea612. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:57:41.249181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-32e67c85-277d-4fd1-b09d-fcbb5ae69a45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Getting quotas for user 8ad6564a2e9a43c2bdb0358622ff3415 and project 53d04fe2eaaf43fc82d82f344faea612. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:57:41.296245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-32e67c85-277d-4fd1-b09d-fcbb5ae69a45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.394947 Sep 07 07:57:41.297989 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 147/311] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 07:57:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:41.748176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:41.749958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:41.773029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:41.773833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:41.775968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:41.776976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:41.778002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:41.778605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:41.823867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:41.824679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:41.840404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:41.845697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:41.846242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:41.847710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:41.848911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:41.849426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:42.196696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:42.210649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:42.215334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:42.219962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:42.221408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d40a0944-78f0-42e9-a26b-813dc106d70a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.485060 Sep 07 07:57:42.225055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 165/312] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:41 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:42.237021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-886241c8-e24d-4f9a-bb51-39a797d80bba req-e4083c16-e255-4f9f-b0ab-fd9cd4e3436e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bf06d0-30dc-4a08-94a4-bac302f07efb", "name": "network-vif-plugged", "status": "completed", "tag": "21b12ceb-ddd4-48f9-8f8c-e7c2fd169986"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:42.242197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c17d9b96-de16-456e-a897-8e6aacc84e3b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.422879 Sep 07 07:57:42.242973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 148/313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:41 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:42.281953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-886241c8-e24d-4f9a-bb51-39a797d80bba req-e4083c16-e255-4f9f-b0ab-fd9cd4e3436e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:42.285942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-886241c8-e24d-4f9a-bb51-39a797d80bba req-e4083c16-e255-4f9f-b0ab-fd9cd4e3436e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:42.285942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-886241c8-e24d-4f9a-bb51-39a797d80bba req-e4083c16-e255-4f9f-b0ab-fd9cd4e3436e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:42.320879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-886241c8-e24d-4f9a-bb51-39a797d80bba req-e4083c16-e255-4f9f-b0ab-fd9cd4e3436e service nova] Creating event network-vif-plugged:21b12ceb-ddd4-48f9-8f8c-e7c2fd169986 for instance 86bf06d0-30dc-4a08-94a4-bac302f07efb on hv-cinder-83602 Sep 07 07:57:42.332328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-886241c8-e24d-4f9a-bb51-39a797d80bba req-e4083c16-e255-4f9f-b0ab-fd9cd4e3436e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105136 Sep 07 07:57:42.337129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 166/314] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:42.804201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-750359306", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d7d7a39-e6a6-423e-b552-9ec48c064b08"}], "security_groups": [{"name": "tempest-securitygroup--335595302"}], "key_name": "tempest-keypair-89093674", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:42.981554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] validate_networks() for [('3d7d7a39-e6a6-423e-b552-9ec48c064b08', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:57:43.257489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:43.258198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:43.290092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:43.290577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:43.291008 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:43.296823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:43.298967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:43.299430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:43.657174 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:43.683254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:43.686156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:43.689339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3cc8056a-4f3c-410c-861c-0aef2442332c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.437164 Sep 07 07:57:43.693330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 167/315] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:43 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:57:43.702286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:43.702899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:43.712437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:43.712926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:43.713431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:43.714338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:43.720617 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:43.725207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:43.768324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:43.797359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:57:43.797791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:57:43.798272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:57:43.798939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:57:43.799357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:57:43.819150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:43.820557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:43.821008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:43.825158 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:43.825648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:43.826100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:43.848829 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:43.876336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:57:43.885560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:57:43.931472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:57:43.935328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:57:44.029346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:44.044156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27c8c2cb-e2e1-4cdd-b7f1-244854eafe34 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.348300 Sep 07 07:57:44.052138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 168/316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:43 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:44.078469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-41f4ca6c-02ac-4d93-990c-8663b61a9692 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.281530 Sep 07 07:57:44.079129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 149/317] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:57:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:57:44.092330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-788f91cd-6d7f-4ba6-b421-47b3663b8daf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:44.092980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-788f91cd-6d7f-4ba6-b421-47b3663b8daf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:44.165116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-788f91cd-6d7f-4ba6-b421-47b3663b8daf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:44.173763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-788f91cd-6d7f-4ba6-b421-47b3663b8daf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1239 microversion: 2.1 time: 0.086318 Sep 07 07:57:44.183441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 169/318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:44 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1239 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:44.730875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:44.732587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:44.773759 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:44.774267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:44.785284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:44.796804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:44.797851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:44.801294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:45.062064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:45.072871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:45.073480 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:45.073926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:45.077060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:45.078308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f4242444-f7be-42b4-9386-7e9a8c65777c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.352182 Sep 07 07:57:45.078794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 150/319] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:44 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:45.090349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:45.090832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:45.091489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:45.092717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:45.093547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:45.094330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:45.210488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:45.211654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:45.219940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:45.220704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:45.221928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:45.223106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:45.223910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:45.224563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:45.302875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:45.314327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-92745f01-70d5-417f-82b3-e97afce7bccd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.246287 Sep 07 07:57:45.315909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 170/320] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:45 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:45.337361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:45.348808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a02686da-cd37-43d2-99ee-062ddc2469c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1243 microversion: 2.1 time: 0.146089 Sep 07 07:57:45.352720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 151/321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:45 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1243 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:46.118245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:46.120111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:46.133598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.137208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.140536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.141375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.143662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.144618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.348237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:46.349123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:46.360821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.365228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.366039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.367015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.367698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.368530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.390589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:46.402129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:46.408356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:46.410661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c39f8b97-4a43-4c91-a3ca-cc70639cbb7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.300385 Sep 07 07:57:46.414980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 171/322] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:46 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:46.419936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:46.423670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:46.437666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.440652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.441812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.442717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.446273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.446900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.539975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:46.547865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5175d269-8d8a-4241-82bd-261871c88069 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1291 microversion: 2.1 time: 0.131561 Sep 07 07:57:46.551764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 172/323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:46 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1291 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:46.608855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:46.618550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-69b0212a-05e5-409b-b214-cf2eb40bec56 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1503 microversion: 2.1 time: 0.278584 Sep 07 07:57:46.619596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 152/324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:46 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:46.642967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9dbfe27-5b8d-49d3-8ef8-6498ef0e59b2"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:46.645949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:46.652467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.653165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.653767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.654455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.655067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.655642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.684959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] HTTP exception thrown: Cannot 'attach_volume' instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 while it is in vm_state rescued Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Request method failure captured: Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6/os-volume_attachments HTTP/1.1 Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 74 Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5sTGRLiOMZ9BztMknjwb1bTtmawAr05yKxmMY6XSOU-KGdsmV2iVQKqW9_UUIk6hFZCmT4z6YqxgGZt599G6X9iaYWqSu0TMD3sA6Re6ROAEQYf9ZHymvf2WTN82nDB54vuXv7oje7dmNjBVjSQD6pA5gfJ7cozNzZVvgrcxmLLHk Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:57:46.687117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4d3d7139782f4b63ac6dc8d4618abe64", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: b52ececfc19b41b5b8387dc6908d4a4a Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {"volumeAttachment": {"volumeId": "b9dbfe27-5b8d-49d3-8ef8-6498ef0e59b2"}} Sep 07 07:57:46.688733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Cannot 'attach_volume' instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 while it is in vm_state rescued Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'server_id': 'ee87953e-ba27-4c28-b0db-0dfa81b496e6', 'body': {'volumeAttachment': {'volumeId': 'b9dbfe27-5b8d-49d3-8ef8-6498ef0e59b2'}}} Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:57:46.689473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 while it is in vm_state rescued Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:57:46.690943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:57:46.692118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:57:46.692118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:57:46.692118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 while it is in vm_state rescued Sep 07 07:57:46.692118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:57:46.693659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Returning 409 to user: Cannot 'attach_volume' instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 while it is in vm_state rescued {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:57:46.694733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec4b07c9-a6fc-4569-9901-9c3abb312815 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056086 Sep 07 07:57:46.701422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 173/325] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 07:57:46 2022] POST /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 07:57:46.704839 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:46.705379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:46.714728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.715492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.716020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.716928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.717613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.718131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.805104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3f1375ae-e1af-401a-9d96-a67c054820ca tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6/action" status: 202 len: 0 microversion: 2.1 time: 0.104313 Sep 07 07:57:46.806799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 153/326] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:57:46 2022] POST /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:57:46.815382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:46.817625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:46.827339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.828194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.828903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:46.830107 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:46.830815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:46.832012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:47.085935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:47.116604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2cb2d346-dc94-4319-bc0c-090be1cfffe2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1511 microversion: 2.1 time: 0.305101 Sep 07 07:57:47.126071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 174/327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:46 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:47.448050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:47.449617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:47.456815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:47.457618 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:47.458184 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:47.459016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:47.459588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:47.460126 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:47.580867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:47.582164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:47.594513 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:47.595989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:47.597619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:47.598355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:47.599722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:47.600187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:47.693593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:47.704618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eacb1499-4c3a-4612-9eb7-2b059ef1be77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1297 microversion: 2.1 time: 0.133244 Sep 07 07:57:47.705953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 175/328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:47 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:47.808314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:47.818704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:47.821114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:47.822522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4d0f2d87-9968-46ae-96d6-b4a781da2947 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.386764 Sep 07 07:57:47.823693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 154/329] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:47 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:57:48.153622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:48.154525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:48.169449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:48.171523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:48.174473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:48.176814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:48.179032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:48.180999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:48.493491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:48.507050 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ac4d8e0f-dbb8-42b6-a8b9-e311815bd90e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1511 microversion: 2.1 time: 0.360857 Sep 07 07:57:48.512888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 176/330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:48 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:48.729139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:48.729896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:48.747657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:48.748567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:48.750668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:48.751728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:48.752468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:48.754077 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:48.850726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:48.851000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:48.851203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:48.857611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:48.858103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:48.858547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:48.859259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:48.859715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:48.860009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0944275a-76e4-41d8-96c9-b689f57a13c0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1297 microversion: 2.1 time: 0.134333 Sep 07 07:57:48.860158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:48.861056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 155/331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:48 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:49.176095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:49.192335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:49.193924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:49.195105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-208d2b89-6524-460a-a2d9-536c2367ca42 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.349645 Sep 07 07:57:49.196563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 177/332] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:48 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:49.535103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:49.535737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:49.541927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:49.542607 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:49.543201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:49.544052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:49.544782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:49.545423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:49.701486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:49.709936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9c1ae173-dcf7-4e23-b08c-8b6f1328a54d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1511 microversion: 2.1 time: 0.178930 Sep 07 07:57:49.710781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 156/333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:49 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:49.889484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:49.890167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:49.897998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:49.898407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:49.898845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:49.899550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:49.900007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:49.900467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:50.056332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:50.066566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7bf3cb87-bfcf-473f-b694-25cfe146245c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.181006 Sep 07 07:57:50.067313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 178/334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:49 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:50.222932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:50.223672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:50.230677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:50.231251 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:50.231689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:50.232422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:50.232878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:50.234993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:50.404643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:50.414253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:50.416958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:50.418693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-45f21874-007b-4f24-93db-e22324006e36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.200581 Sep 07 07:57:50.419794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 157/335] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:50 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:50.734423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:50.735130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:50.743079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:50.743948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:50.744452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:50.745956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:50.746752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:50.747772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:50.916130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:50.928639 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-168b76fe-bc5b-4b2f-8e2b-217a4ef8633c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1511 microversion: 2.1 time: 0.198072 Sep 07 07:57:50.929679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 179/336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:50 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:51.090696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:51.091309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:51.099318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:51.100071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:51.100691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:51.101654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:51.102256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:51.102840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:51.330880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:51.340691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6b32f5c2-881c-49b6-98e0-5354efa8d13e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.254398 Sep 07 07:57:51.356642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 158/337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:51 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:51.444009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:51.444946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:51.451167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:51.451936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:51.452596 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:51.453337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:51.453810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:51.454589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:51.530661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-afe0aae9-474f-4dba-b772-3512a60cb0f9 req-6e96416d-d7f4-4c8d-ad0d-e8cf2c73d543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a6fa25-3c84-48c7-a503-524e02cbb19b", "tag": "bf926a4a-8baa-4366-9fa1-db0fa2688aa2"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:51.542240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-afe0aae9-474f-4dba-b772-3512a60cb0f9 req-6e96416d-d7f4-4c8d-ad0d-e8cf2c73d543 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:51.543013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-afe0aae9-474f-4dba-b772-3512a60cb0f9 req-6e96416d-d7f4-4c8d-ad0d-e8cf2c73d543 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:51.543621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-afe0aae9-474f-4dba-b772-3512a60cb0f9 req-6e96416d-d7f4-4c8d-ad0d-e8cf2c73d543 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:51.576064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-afe0aae9-474f-4dba-b772-3512a60cb0f9 req-6e96416d-d7f4-4c8d-ad0d-e8cf2c73d543 service nova] Creating event network-changed:bf926a4a-8baa-4366-9fa1-db0fa2688aa2 for instance f6a6fa25-3c84-48c7-a503-524e02cbb19b on hv-cinder-83602 Sep 07 07:57:51.581348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-afe0aae9-474f-4dba-b772-3512a60cb0f9 req-6e96416d-d7f4-4c8d-ad0d-e8cf2c73d543 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055057 Sep 07 07:57:51.582870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 159/338] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:57:51.679798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:51.687936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:51.689608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:51.691135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b64692f-e111-4cae-99fc-ca9c837c63e3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.251413 Sep 07 07:57:51.692669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 180/339] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:51 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:51.954620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:51.956528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:51.968019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:51.968658 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:51.969233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:51.970606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:51.971769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:51.972171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:52.169243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:52.185074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-14a8388e-c737-4bca-bdc2-0f4fadc66485 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1517 microversion: 2.1 time: 0.234636 Sep 07 07:57:52.187073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 160/340] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:51 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:52.369319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:52.370664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:52.378886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:52.379529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:52.380099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:52.380929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:52.381518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:52.382092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:52.618634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:52.627650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9aa2ac42-8621-4e88-a89c-86880be0a530 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.262519 Sep 07 07:57:52.629183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 181/341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:52 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:52.718986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:52.720375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:52.729018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:52.733571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:52.734466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:52.736954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:52.738426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:52.740826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:52.747089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:53.032918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:53.042469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:53.044220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:53.046088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-95246a67-fb1a-4852-89c6-61a788a32916 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.331626 Sep 07 07:57:53.060495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 161/342] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:52 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:53.653693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:53.654249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:53.661384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:53.661862 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:53.662295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:53.662979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:53.663462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:53.663886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:53.802669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:53.812612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7c0251f-e682-4f43-8253-57ad26ca5162 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.162811 Sep 07 07:57:53.813479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 182/343] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:53 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:53.871407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ef10051f-bccb-4b32-b59e-241df386e174 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'create', calling method: .version_select at 0x7f831ed00280>, body: {"keypair": {"name": "tempest-keypair-546569741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcujxQVfOvsKhYRlR/fJH4zyInHAENJzK3Z7kQ1tY/71cPj9VQolP9a6q6KK78ytEhBJVn5Xy6ppfldm4GAOt/kP/aFCibKLl2ZPaTSdo6Cos9NaK/e1tt4K82WrIItZQ=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:53.877103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:53.889152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-ef10051f-bccb-4b32-b59e-241df386e174 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:57:53.892950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-ef10051f-bccb-4b32-b59e-241df386e174 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for user b52ececfc19b41b5b8387dc6908d4a4a and project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:57:53.914643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ef10051f-bccb-4b32-b59e-241df386e174 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047300 Sep 07 07:57:53.915172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 162/344] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 07:57:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:57:54.072838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:54.073452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:54.079518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:54.080007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:54.080476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:54.081176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:54.081639 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:54.082058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:54.170140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:54.226922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:54.235275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:54.236803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:54.238511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f87ff53-15f0-43c6-8a41-dfc2d2b67689 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1740 microversion: 2.20 time: 0.169704 Sep 07 07:57:54.239061 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 183/345] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:54 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:54.837254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:54.837887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:54.843990 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:54.844829 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:54.845425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:54.846324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:54.846942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:54.847354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:55.095253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:55.103375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-37018195-7e43-463a-bb14-1c10910d3a0f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.270925 Sep 07 07:57:55.104203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 163/346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:54 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:55.264107 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:55.264725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:55.266913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:55.272956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:55.273441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:55.273877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:55.274681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:55.275143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:55.275566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:55.417548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:55.427136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:55.429061 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:55.430766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-36efc76d-5947-4150-82b5-ffc06b75b874 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1722 microversion: 2.20 time: 0.170614 Sep 07 07:57:55.431580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 184/347] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:55 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:55.552856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1963471595", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "811e9a20-36aa-4e45-b990-9e2b0dd7f3c3"}], "security_groups": [{"name": "tempest-securitygroup--615628941"}], "key_name": "tempest-keypair-546569741", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:55.657246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] validate_networks() for [('811e9a20-36aa-4e45-b990-9e2b0dd7f3c3', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:57:56.126754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:56.127364 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:56.133798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:56.134278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:56.134706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:56.135396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:56.135846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:56.136297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:56.267158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:56.276039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75a719e9-fde5-499b-9a33-71fb020a6d7d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.153173 Sep 07 07:57:56.276938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 185/348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:56 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:56.338597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:57:56.339081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:57:56.339516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:57:56.339925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:57:56.340372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:57:56.349378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:56.349975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:56.350413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:56.351192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:56.351652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:56.352095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:56.369368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:57:56.373210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Getting quotas for user b52ececfc19b41b5b8387dc6908d4a4a and project 4d3d7139782f4b63ac6dc8d4618abe64. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:57:56.389823 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:57:56.392402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:57:56.442523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9934b922-2388-43ae-ab3c-829d661dc410 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.894622 Sep 07 07:57:56.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 164/349] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:57:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:57:56.454749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b84bb49a-b47b-4784-b03f-a6b6e952d67f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:56.455353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b84bb49a-b47b-4784-b03f-a6b6e952d67f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:56.463215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:56.463438 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:56.470743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:56.471232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:56.471689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:56.473018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:56.473250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:56.473676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:56.519142 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b84bb49a-b47b-4784-b03f-a6b6e952d67f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:56.527280 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b84bb49a-b47b-4784-b03f-a6b6e952d67f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1245 microversion: 2.1 time: 0.076152 Sep 07 07:57:56.528254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 186/350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:56 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:56.619033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:56.628323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:56.629828 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:56.631018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b0b9c84c-5eeb-49c7-9fbf-076329d584f4 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1722 microversion: 2.20 time: 0.172054 Sep 07 07:57:56.631762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 165/351] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:56 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:57.298966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:57.299743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:57.310628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:57.311119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:57.311665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:57.312413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:57.312883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:57.313313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:57.332340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:57.445258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:57.452895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bed1f376-b2fc-4525-bf21-756bb6f3d029 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.157911 Sep 07 07:57:57.453449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 187/352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:57 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:57.550730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:57.551266 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:57.557615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:57.558092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:57.558521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:57.559197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:57.559645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:57.560063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:57.624185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:57.632861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-da91aa05-f5cb-4646-af85-be12ac255f2e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1249 microversion: 2.1 time: 0.085989 Sep 07 07:57:57.633682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 166/353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:57 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:57.657887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:57.658493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:57.664637 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:57.665116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:57.666325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:57.666325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:57.666761 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:57.667180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:57.798501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:57.807522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:57.808943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:57.810095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4d0d80ba-b047-4858-8e3e-32ce9a88dbc1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1722 microversion: 2.20 time: 0.156176 Sep 07 07:57:57.810684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 188/354] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:57 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:58.477079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:58.477641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:58.484201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:58.484689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:58.485121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:58.485815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:58.486272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:58.486695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:58.622590 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:58.626029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:57:58.631639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-45a18b95-768a-4de4-b023-a78da3f932c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.158790 Sep 07 07:57:58.632246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 167/355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:58 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:58.655760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:58.656478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:58.662992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:58.663485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:58.663928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:58.664664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:58.665129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:58.665559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:58.744646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:58.753150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d3ae927-d5c9-48f7-bbe9-71cd7efea8e1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1241 microversion: 2.1 time: 0.100599 Sep 07 07:57:58.753753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 189/356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:58 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:58.835868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:58.836502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:58.842945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:58.843437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:58.844003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:58.844714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:58.845169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:58.845586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:58.982025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:58.990164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:58.991668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:58.992787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-843446a8-173c-460e-adaf-0a079c88596b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1725 microversion: 2.20 time: 0.161956 Sep 07 07:57:58.993323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 168/357] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:58 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:57:59.017741 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "314a6666-641c-416e-81a4-20398fa758f3"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:59.020372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:59.026461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.027032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.027658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.028572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.029042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.029514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.309598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c94c36cd-861e-4200-be6a-4b3e75a8a957 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295751 Sep 07 07:57:59.312190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 190/358] 10.222.0.26 () {62 vars in 1364 bytes} [Wed Sep 7 07:57:59 2022] POST /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:57:59.454684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:59.455277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:59.461733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.462218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.462653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.463344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.463802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.464275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.520030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120495) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 07:57:59.606356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7a99a4e1-1eef-4712-8f1b-f69db7cbded6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/action" status: 202 len: 0 microversion: 2.20 time: 0.155546 Sep 07 07:57:59.610786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 169/359] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Sep 7 07:57:59 2022] POST /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 07:57:59.615859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:59.616504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:59.623240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.623650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.624180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.624895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.625354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.625779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.657557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:59.658181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:59.664561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.664979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.665421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.666155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.666614 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.667045 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.810849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:59.821952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:59.823578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:59.825068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2722f8a-d011-4a3a-a3b1-edaabda60959 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1811 microversion: 2.20 time: 0.213347 Sep 07 07:57:59.836117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 191/360] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:57:59 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1811 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:57:59.836117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:57:59.836117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:57:59.844829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.844829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.844829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.844829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.845229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.845229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.888983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:59.897902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-25e0470f-1317-421f-9e72-a462188b264d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.247856 Sep 07 07:57:59.901239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 170/361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:59 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:57:59.933642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-575004d0-70cd-4384-b1ac-796014da2e29 req-b4d69803-b40a-46ef-9ec9-690b023c829e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a6fa25-3c84-48c7-a503-524e02cbb19b", "name": "network-vif-plugged", "status": "completed", "tag": "bf926a4a-8baa-4366-9fa1-db0fa2688aa2"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:57:59.937047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:57:59.947843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-575004d0-70cd-4384-b1ac-796014da2e29 req-b4d69803-b40a-46ef-9ec9-690b023c829e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:57:59.948882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-575004d0-70cd-4384-b1ac-796014da2e29 req-b4d69803-b40a-46ef-9ec9-690b023c829e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:57:59.949099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2219f863-784f-465f-9782-1ea1f2d26c64 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1303 microversion: 2.1 time: 0.121283 Sep 07 07:57:59.949744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-575004d0-70cd-4384-b1ac-796014da2e29 req-b4d69803-b40a-46ef-9ec9-690b023c829e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:57:59.950801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 192/362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:57:59 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:57:59.964331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-575004d0-70cd-4384-b1ac-796014da2e29 req-b4d69803-b40a-46ef-9ec9-690b023c829e service nova] Creating event network-vif-plugged:bf926a4a-8baa-4366-9fa1-db0fa2688aa2 for instance f6a6fa25-3c84-48c7-a503-524e02cbb19b on hv-cinder-83602 Sep 07 07:57:59.970923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-575004d0-70cd-4384-b1ac-796014da2e29 req-b4d69803-b40a-46ef-9ec9-690b023c829e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041363 Sep 07 07:57:59.972375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 171/363] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:58:00.853530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:00.854195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:00.861121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:00.861614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:00.863089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:00.863856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:00.864290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:00.864729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:00.923675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:00.925212 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:00.938931 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:00.939582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:00.940909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:00.944055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:00.944648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:00.945160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:01.051889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:01.061117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:01.062798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:01.063946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-994d4f0d-1997-413b-ad1e-efcac031b7d3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1751 microversion: 2.20 time: 0.215028 Sep 07 07:58:01.064524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 193/364] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:00 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:01.075400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:01.076153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:01.082752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:01.083231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:01.083661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:01.084372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:01.084824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:01.085263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:01.229139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:01.237089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0184b2b8-5c60-47b4-94aa-0df16c4fba47 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1364 microversion: 2.1 time: 0.317440 Sep 07 07:58:01.240378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 172/365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:00 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:01.240882 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:01.247918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1038178298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-629093183", "security_groups": [{"name": "tempest-secgroup-smoke-79710983"}], "networks": [{"uuid": "857656ed-8d3e-49ee-9208-c4805ccaa59f"}], "block_device_mapping_v2": [{"uuid": "fa4cce71-56c6-46a1-8851-fc43bf9e9ff7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:01.249579 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eb33447a-3ebd-4373-9052-4abc8a4aa165 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.183254 Sep 07 07:58:01.250289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 194/366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:01 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:01.392428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] validate_networks() for [('857656ed-8d3e-49ee-9208-c4805ccaa59f', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:58:01.559726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-c2fbdbfc-8bb1-4ca7-a84b-36fa709bf4d4 req-a26570e7-53eb-4378-8d98-1910babda035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4aca7e-3298-4cfa-9690-01676e2e1ab1", "tag": "3a3f0e9f-714c-4d7f-8738-852d6e45f0b5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:01.569558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2fbdbfc-8bb1-4ca7-a84b-36fa709bf4d4 req-a26570e7-53eb-4378-8d98-1910babda035 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:01.570150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2fbdbfc-8bb1-4ca7-a84b-36fa709bf4d4 req-a26570e7-53eb-4378-8d98-1910babda035 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:01.570573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-c2fbdbfc-8bb1-4ca7-a84b-36fa709bf4d4 req-a26570e7-53eb-4378-8d98-1910babda035 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:01.582051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-c2fbdbfc-8bb1-4ca7-a84b-36fa709bf4d4 req-a26570e7-53eb-4378-8d98-1910babda035 service nova] Creating event network-changed:3a3f0e9f-714c-4d7f-8738-852d6e45f0b5 for instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 on hv-cinder-83602 Sep 07 07:58:01.586957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-c2fbdbfc-8bb1-4ca7-a84b-36fa709bf4d4 req-a26570e7-53eb-4378-8d98-1910babda035 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031021 Sep 07 07:58:01.587702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 195/367] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:58:02.003471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e0d61fa9-9a1e-448b-856a-22d6b3cfc7a1 req-c47f4022-dd58-47a2-a0c7-46743d20a365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bf06d0-30dc-4a08-94a4-bac302f07efb", "name": "network-vif-unplugged", "status": "completed", "tag": "21b12ceb-ddd4-48f9-8f8c-e7c2fd169986"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:02.012985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0d61fa9-9a1e-448b-856a-22d6b3cfc7a1 req-c47f4022-dd58-47a2-a0c7-46743d20a365 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.013466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0d61fa9-9a1e-448b-856a-22d6b3cfc7a1 req-c47f4022-dd58-47a2-a0c7-46743d20a365 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.013896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e0d61fa9-9a1e-448b-856a-22d6b3cfc7a1 req-c47f4022-dd58-47a2-a0c7-46743d20a365 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.024716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.compute.server_external_events [req-e0d61fa9-9a1e-448b-856a-22d6b3cfc7a1 req-c47f4022-dd58-47a2-a0c7-46743d20a365 service nova] Unable to find a host for instance 86bf06d0-30dc-4a08-94a4-bac302f07efb. Dropping event network-vif-unplugged {{(pid=120494) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 07:58:02.025590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e0d61fa9-9a1e-448b-856a-22d6b3cfc7a1 req-c47f4022-dd58-47a2-a0c7-46743d20a365 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026815 Sep 07 07:58:02.026361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 196/368] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 07 07:58:02.090141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:58:02.090658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:02.090761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:58:02.091022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:02.091143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:58:02.091434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:58:02.091846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:58:02.098367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.098959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.099397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.100113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.100566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.100992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.101767 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.102249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.102689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.103413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.103866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.104322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.121716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Getting quotas for project 53d04fe2eaaf43fc82d82f344faea612. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:58:02.125947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Getting quotas for user 8ad6564a2e9a43c2bdb0358622ff3415 and project 53d04fe2eaaf43fc82d82f344faea612. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:58:02.193047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:58:02.195467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa4cce71-56c6-46a1-8851-fc43bf9e9ff7',volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:58:02.247281 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:02.257379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:02.258834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:02.259987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d93d19e4-6d9f-4983-9d17-ab9574d6cf0e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1753 microversion: 2.20 time: 0.173669 Sep 07 07:58:02.272245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 197/369] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:02 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:58:02.277181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:02.278030 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:02.284711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.285187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.285753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.286457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.286932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.287447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.331501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f895f1ee-6646-45e8-bdba-e9b22fbcf449 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.089043 Sep 07 07:58:02.332472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 173/370] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:58:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:58:02.337189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:02.337963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:02.344183 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.344885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.345472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.347011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.347632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.348248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.431363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:02.440017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a4f1109-eeac-4eb8-9d1c-9ba98c2b2c20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1555 microversion: 2.1 time: 0.166685 Sep 07 07:58:02.441172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 198/371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:02 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:02.451710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-54f69253-60ee-400f-bdfd-18686a286982 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:02.452391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-54f69253-60ee-400f-bdfd-18686a286982 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:02.505796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:02.514821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-54f69253-60ee-400f-bdfd-18686a286982 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:02.514998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dd784973-9058-46ae-bce6-808b006636a4 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.181127 Sep 07 07:58:02.515387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 174/372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:02 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:02.522709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-54f69253-60ee-400f-bdfd-18686a286982 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1088 microversion: 2.1 time: 0.080385 Sep 07 07:58:02.523232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 199/373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:02 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:02.531464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:02.531970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:02.540057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.540588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.541170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.541899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:02.542405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:02.542821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:02.625908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cadbb6f1-b667-440e-be56-1443475c8ee9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109164 Sep 07 07:58:02.626489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 175/374] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 07:58:02 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:03.290243 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:03.291886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:03.300443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:03.302147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:03.302844 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:03.304249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:03.305572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:03.306285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:03.539726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:03.540397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:03.547295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:03.547781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:03.548250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:03.548944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:03.550670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:03.551110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:03.574834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:03.588054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:03.590644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:03.592131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-642ac2d6-ee22-4a33-bbdb-533c549ebc28 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.306945 Sep 07 07:58:03.593230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 200/375] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:03 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:03.603934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:03.605153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:03.613217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:03.613922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:03.614354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:03.615094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:03.615738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:03.616196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:03.706049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:03.707421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:03.714904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5f58747e-73dc-4aaa-9a14-3beae95447bf tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.179573 Sep 07 07:58:03.721910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b71032a-5087-4fb0-8f8b-3f5c77fb1972 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1130 microversion: 2.1 time: 0.126482 Sep 07 07:58:03.722782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 201/376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:03 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1130 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:03.730323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 176/377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:03 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:03.984743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-19159b59-fa0b-4885-9306-5524a30c05f0 req-e65bc063-4dad-4e8f-8528-3858cc3a2ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a6fa25-3c84-48c7-a503-524e02cbb19b", "tag": "bf926a4a-8baa-4366-9fa1-db0fa2688aa2"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:03.997576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-19159b59-fa0b-4885-9306-5524a30c05f0 req-e65bc063-4dad-4e8f-8528-3858cc3a2ed4 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:03.998054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-19159b59-fa0b-4885-9306-5524a30c05f0 req-e65bc063-4dad-4e8f-8528-3858cc3a2ed4 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:03.998710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-19159b59-fa0b-4885-9306-5524a30c05f0 req-e65bc063-4dad-4e8f-8528-3858cc3a2ed4 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:04.013665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-19159b59-fa0b-4885-9306-5524a30c05f0 req-e65bc063-4dad-4e8f-8528-3858cc3a2ed4 service nova] Creating event network-changed:bf926a4a-8baa-4366-9fa1-db0fa2688aa2 for instance f6a6fa25-3c84-48c7-a503-524e02cbb19b on hv-cinder-83602 Sep 07 07:58:04.021255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-19159b59-fa0b-4885-9306-5524a30c05f0 req-e65bc063-4dad-4e8f-8528-3858cc3a2ed4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040001 Sep 07 07:58:04.022189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 202/378] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:04.618724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:04.619267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:04.625652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:04.626132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:04.626572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:04.627285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:04.629098 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:04.629536 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:04.747945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:04.748760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:04.755864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:04.756378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:04.756817 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:04.757522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:04.757982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:04.758407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:04.764500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:04.774146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:04.775562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:04.776746 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4353402e-2294-4272-8704-ddb4759350c9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.162040 Sep 07 07:58:04.777298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 177/379] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:04 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:04.782036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:04.782724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:04.789200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:04.789682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:04.790112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:04.790795 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:04.791243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:04.791660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:04.858994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:04.867512 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3fa2f4a9-aebe-4124-971d-8c936af4c334 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1186 microversion: 2.1 time: 0.089031 Sep 07 07:58:04.868110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 178/380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:04 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:04.911968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:04.919995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9515e742-d75d-46e2-a288-ab28638909e0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.178026 Sep 07 07:58:04.920602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 203/381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:04 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:05.806056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:05.806690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:05.813341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:05.813823 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:05.814251 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:05.814989 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:05.815693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:05.816132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:05.891589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:05.892257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:05.899895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:05.900429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:05.900881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:05.901665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:05.902162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:05.902633 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:05.923841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:05.985561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:05.995555 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c881e00-22e9-415f-b07d-7c6c7ccdfde4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1204 microversion: 2.1 time: 0.108534 Sep 07 07:58:05.996284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 204/382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:05 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:06.006843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:06.007611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:06.014121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:06.014616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:06.015051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:06.015753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:06.016238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:06.016667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:06.160745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:06.168399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6ea05576-8603-4bdf-b4bf-7ba1d2c74c39 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.165640 Sep 07 07:58:06.168972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 205/383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:05 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:06.411754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:06.420734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:06.422188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:06.423353 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8f41706e-b8ac-40f6-855a-f4f780bba22d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.622069 Sep 07 07:58:06.423925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 179/384] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:05 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:07.020282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:07.021047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:07.031488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:07.032335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:07.032807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:07.034276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:07.034930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:07.035407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:07.112928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:07.124697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6250fc5f-397d-4f57-afe5-e7f3b3acfefe tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1192 microversion: 2.1 time: 0.107946 Sep 07 07:58:07.125933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 206/385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:07 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:07.191504 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:07.192138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:07.199500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:07.199991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:07.200466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:07.201151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:07.201600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:07.202029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:07.451465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:07.452463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:07.462963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:07.468615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:07.469389 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:07.470333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:07.470446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:07.471725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:07.472504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:07.479579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-37dbc377-4461-423c-8735-155e8373cdc0 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.292477 Sep 07 07:58:07.484485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 180/386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:07 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:07.638538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:07.648675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:07.650425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:07.652262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bfcce609-2e97-47e1-95f0-ba6d1c6f23f2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.205407 Sep 07 07:58:07.653448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 207/387] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:07 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:58:08.150717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:08.151321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:08.157468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:08.157957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:08.158394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:08.159115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:08.159564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:08.159988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:08.306070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:08.318400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-010c27f4-33e8-4003-986c-3650e7c8d876 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.171360 Sep 07 07:58:08.324450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 181/388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:08 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:08.508109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:08.508653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:08.515155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:08.515645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:08.516099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:08.516917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:08.517372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:08.517974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:08.655525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:08.664016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-959b6650-d2a0-4faa-a61d-30d6541055e3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.160061 Sep 07 07:58:08.664609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 208/389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:08 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:08.678886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:08.679515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:08.685570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:08.686085 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:08.686529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:08.687240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:08.687687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:08.688120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:08.835876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:08.844526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:08.846494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:08.848000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-96110041-8ca6-44ff-9129-7af52afb9474 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.173102 Sep 07 07:58:08.848676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 182/390] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:08 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:09.342540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:09.343148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:09.350003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:09.350374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:09.350811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:09.351505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:09.351966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:09.352427 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:09.509192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:09.518602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-95b9c4e8-6db9-4165-a520-70bedf8a1380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.179147 Sep 07 07:58:09.519387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 209/391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:09 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:09.700146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:09.703310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:09.713632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:09.713632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:09.716769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:09.716769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:09.716769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:09.716769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:09.870739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:09.880838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ace41736-fb7f-46c3-9268-9da24cc84552 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.196676 Sep 07 07:58:09.881935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 183/392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:09 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:09.884359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:09.885117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:09.897969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:09.898450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:09.898889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:09.899601 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:09.900068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:09.900514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:09.912266 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-b8cfce95-fe82-477e-8743-dcb25e5f498a req-09ee5bd1-2b31-4bfb-b9ea-ae8b45de5e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4aca7e-3298-4cfa-9690-01676e2e1ab1", "name": "network-vif-plugged", "status": "completed", "tag": "3a3f0e9f-714c-4d7f-8738-852d6e45f0b5"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:09.923147 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b8cfce95-fe82-477e-8743-dcb25e5f498a req-09ee5bd1-2b31-4bfb-b9ea-ae8b45de5e66 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:09.923675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b8cfce95-fe82-477e-8743-dcb25e5f498a req-09ee5bd1-2b31-4bfb-b9ea-ae8b45de5e66 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:09.924648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b8cfce95-fe82-477e-8743-dcb25e5f498a req-09ee5bd1-2b31-4bfb-b9ea-ae8b45de5e66 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:09.941959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-b8cfce95-fe82-477e-8743-dcb25e5f498a req-09ee5bd1-2b31-4bfb-b9ea-ae8b45de5e66 service nova] Creating event network-vif-plugged:3a3f0e9f-714c-4d7f-8738-852d6e45f0b5 for instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 on hv-cinder-83602 Sep 07 07:58:09.948214 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-b8cfce95-fe82-477e-8743-dcb25e5f498a req-09ee5bd1-2b31-4bfb-b9ea-ae8b45de5e66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040634 Sep 07 07:58:09.948813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 184/393] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:10.075896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:10.086330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:10.087792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:10.089033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d7636e35-f637-4a17-aa9f-19b6104e242a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.218359 Sep 07 07:58:10.089790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 210/394] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:09 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:10.541853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:10.542746 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:10.549726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:10.550515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:10.550960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:10.551664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:10.552275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:10.552719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:10.695597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:10.699188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:10.704806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f44712d9-7f3a-42ac-81ad-d0c80b058762 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.167141 Sep 07 07:58:10.720401 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 185/395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:10 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:10.904716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:10.905414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:10.912588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:10.913073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:10.913514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:10.914204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:10.914656 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:10.915075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.006241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:11.008759 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:11.016781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.017275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.017771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.018861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.019325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.019754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.072422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:11.080352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-542f4340-6b98-4dba-bd5e-4ecfa72c98bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.180086 Sep 07 07:58:11.081278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 211/396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:10 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:11.113644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c43b0414-be8e-4dad-ac75-0d5b8a655e4c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/action" status: 202 len: 0 microversion: 2.1 time: 0.111430 Sep 07 07:58:11.117213 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 186/397] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:58:11 2022] POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:58:11.119144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:11.119754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:11.122450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:11.123144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:11.125981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.126470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.126895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.127793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.128306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.129039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.130702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:11.133189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.133792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.134258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.135085 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.135545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.135971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.297822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:11.307359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:11.308858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:11.310028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8eb1da2-f596-4151-9458-32fb2c412e54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.195044 Sep 07 07:58:11.310803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 212/398] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:11 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:11.316844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:11.329660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-284f627f-3ef7-4fe3-9177-96181ed2646b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.211085 Sep 07 07:58:11.331214 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 187/399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:11 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:11.727010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:11.727734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:11.734248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.734878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.735398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.736132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:11.736619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:11.737054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:11.873156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:11.882046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e582b36b-a795-4c26-9ff5-ee9e94d992eb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.158770 Sep 07 07:58:11.882843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 213/400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:11 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:12.106293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:12.106991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:12.113295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:12.115071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.115553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.115991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:12.116713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.117168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.117591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:12.134812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:12.274057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:12.281991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-20666f37-6136-4d92-8346-d3232646fd89 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.179692 Sep 07 07:58:12.282845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 188/401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:12 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:12.336346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:12.337059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:12.344657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.345155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.345592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:12.346401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.347029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.347463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:12.354694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:12.355942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:12.362787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.363435 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.363960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:12.364868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.366035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.366757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:12.506950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:12.519077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:12.523872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:12.525666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:12.527030 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a50604a-1c9b-4eae-acbb-355edb02e8a8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.194760 Sep 07 07:58:12.528182 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 214/402] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:12 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:12.544032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:12.555036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-38550b7a-0fd0-4a6e-9993-e021fee527e7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.204180 Sep 07 07:58:12.555610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 189/403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:12 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:12.905185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:12.905800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:12.912775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.913268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.913712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:12.914410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:12.914871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:12.915288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:13.057230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:13.066138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c639a8d5-46d2-42e9-b6e7-f517cde363f5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.164752 Sep 07 07:58:13.067130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 215/404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:12 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:13.304278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:13.304876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:13.311509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:13.311923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:13.312386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:13.313084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:13.313539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:13.313964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:13.461365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:13.469394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3682fb6c-ec6f-49cb-99e6-5955495f3ae6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.168959 Sep 07 07:58:13.470163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 190/405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:13 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:13.553787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:13.554548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:13.561375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:13.561930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:13.562396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:13.563218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:13.563684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:13.564134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:13.579165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:13.581221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:13.586836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:13.587320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:13.587753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:13.588482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:13.588930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:13.594750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:13.704592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:13.715005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:13.716576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:13.717832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-de5a6eeb-fdcf-41d9-89f1-447bbf8b99e6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.168951 Sep 07 07:58:13.718755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 216/406] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:13 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:13.762600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:13.771834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b07df2a7-9713-4963-a0fb-411c15b6c9ed tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.196410 Sep 07 07:58:13.772459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 191/407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:13 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:14.089627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:14.090709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:14.097745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.098234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.098664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.099362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.099814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.100424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.255236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:14.263917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6734f53-d398-4168-83b0-00735e1c669b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.178242 Sep 07 07:58:14.264553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 217/408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:14 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:14.493274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:14.493961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:14.500818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.501391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.502560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.503274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.503737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.504377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.654707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:14.663162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9b24d503-ed2c-456c-8efe-8804dba409b6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.173827 Sep 07 07:58:14.663739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 192/409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:14 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:14.744222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:14.745665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:14.752308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.752853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.753225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.753917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.754365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.754783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.795364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:14.795978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:14.803528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.804019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.804489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.805210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:14.805742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:14.810249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:14.909411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:14.921720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:14.923237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:14.925570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e9c4bdf-8205-4376-83c9-c8a0edc448e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.185460 Sep 07 07:58:14.926466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 218/410] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:14 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:15.011182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:15.020721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-49e5dfae-b963-4ccb-81ab-45f9cd69c350 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.228960 Sep 07 07:58:15.021620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 193/411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:14 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:15.288822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:15.289383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:15.296213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:15.296871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:15.297680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:15.298754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:15.299399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:15.300379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:15.465281 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:15.473882 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-32bf58d9-c55d-431e-ba74-b26354cab397 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.189609 Sep 07 07:58:15.474471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 219/412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:15 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:15.687235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:15.687923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:15.696324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:15.696816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:15.697262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:15.698024 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:15.698474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:15.698905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:15.850959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:15.859967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-770e8dc0-1ea9-4fd9-96b3-f80262daf1ce tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.176899 Sep 07 07:58:15.861040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 194/413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:15 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:15.952219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:15.952783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:15.961095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:15.961587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:15.962023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:15.962731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:15.963191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:15.963611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:16.057811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:16.058426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:16.065003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:16.065740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:16.066169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:16.066859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:16.067305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:16.067728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:16.110591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:16.125462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:16.127856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:16.129376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00f5a46a-a061-441f-92c4-b12b99a23caa tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.181755 Sep 07 07:58:16.130509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 220/414] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:15 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:16.241428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:16.250399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b1017f33-4872-45f0-b0b7-d327c3257488 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.196330 Sep 07 07:58:16.250971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 195/415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:16 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:16.496588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:16.497140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:16.503329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:16.503810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:16.504291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:16.504981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:16.505434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:16.505854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:16.510053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:16.653002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:16.661323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38628b2a-a24c-4351-a31d-65e7226ef9a9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.168588 Sep 07 07:58:16.661904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 221/416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:16 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:16.886350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:16.886771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:16.897648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:16.898135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:16.898678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:16.899569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:16.900205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:16.900633 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:17.063285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:17.071768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-75ec3baf-2368-456a-b3bf-8462972ff764 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.189994 Sep 07 07:58:17.072374 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 196/417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:16 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:17.156472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:17.157145 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:17.164642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:17.165136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:17.165716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:17.166509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:17.167003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:17.167516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:17.274756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:17.275487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:17.281647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:17.282223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:17.282734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:17.284096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:17.284773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:17.285298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:17.312830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:17.322871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:17.324762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:17.326455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-74038c91-428a-4725-b7fe-aa6b007b46eb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.173977 Sep 07 07:58:17.327089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 222/418] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:17 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:17.444804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:17.453114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9202016b-7026-46f6-a029-19f6d7edd2fe tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.182156 Sep 07 07:58:17.453680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 197/419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:17 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:17.684672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:17.685285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:17.692312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:17.692850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:17.693235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:17.694038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:17.694380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:17.694810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:17.827466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:17.835152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d79aa08f-a009-4a1f-89c6-6f1105836924 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.154385 Sep 07 07:58:17.835709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 223/420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:17 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:18.095272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:18.096573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:18.102880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.103361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.103796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:18.104510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.104964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.105385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:18.243760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:18.251318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4497cf79-b857-4639-a837-9ad535490960 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.159935 Sep 07 07:58:18.252013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 198/421] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:18 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:18.352594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:18.353199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:18.359021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.359497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.359928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:18.360630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.361124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.361636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:18.477383 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:18.478317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:18.486449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.487017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.487606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:18.488486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.488937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.489577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:18.508309 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:18.529310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:18.530759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:18.532006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-165035e5-ff98-48e8-bc61-031e57d551d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.183238 Sep 07 07:58:18.532640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 224/422] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:18 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:18.751135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:18.759390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-437fefb4-60fd-432a-b5c8-d485d2473ea7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.287534 Sep 07 07:58:18.759950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 199/423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:18 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:18.858856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:18.859461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:18.865807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.866290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.866721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:18.867406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:18.867853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:18.868312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.002774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:19.010892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3d95181-7110-44f6-825d-236c48211fc8 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.156178 Sep 07 07:58:19.011596 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 225/424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:18 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:19.238452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-3461863f-277e-4883-ae79-5d2c9dd84bb1 req-9dc0b182-192d-4e22-ab19-6d7d8a95d302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a500c169-e521-4f76-b825-f3c52a0583fb", "tag": "ccdaaab5-715d-42e0-bff3-ea1b67a8f356"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:19.248355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3461863f-277e-4883-ae79-5d2c9dd84bb1 req-9dc0b182-192d-4e22-ab19-6d7d8a95d302 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:19.248910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3461863f-277e-4883-ae79-5d2c9dd84bb1 req-9dc0b182-192d-4e22-ab19-6d7d8a95d302 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:19.249463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3461863f-277e-4883-ae79-5d2c9dd84bb1 req-9dc0b182-192d-4e22-ab19-6d7d8a95d302 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.261241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-3461863f-277e-4883-ae79-5d2c9dd84bb1 req-9dc0b182-192d-4e22-ab19-6d7d8a95d302 service nova] Creating event network-changed:ccdaaab5-715d-42e0-bff3-ea1b67a8f356 for instance a500c169-e521-4f76-b825-f3c52a0583fb on hv-cinder-83602 Sep 07 07:58:19.266015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-3461863f-277e-4883-ae79-5d2c9dd84bb1 req-9dc0b182-192d-4e22-ab19-6d7d8a95d302 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031318 Sep 07 07:58:19.266601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 200/425] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:19.274089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:19.274695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:19.281062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:19.281543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:19.281976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.282690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:19.283315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:19.283783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.423048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:19.430961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55099b0d-9eb9-428a-81b6-6f44a398a092 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.160741 Sep 07 07:58:19.431523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 226/426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:19 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:19.557550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:19.558390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:19.566567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:19.567273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:19.567854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.568833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:19.569364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:19.569888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.735259 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:19.744813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:19.746250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:19.747417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c6c4d6f0-e354-4232-bf2a-287057c9e5e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.194348 Sep 07 07:58:19.747964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 201/427] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:19 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:19.783366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:19.784874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:19.791106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:19.791594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:19.792024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.792787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:19.793238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:19.793660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:19.949304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:19.958108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d76b578-7949-46c1-a6a0-b344a8b082d7 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.179010 Sep 07 07:58:19.958752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 227/428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:19 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:20.036416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:20.037456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:20.043280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.043813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.044301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:20.044997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.045459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.045885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:20.051314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:20.179831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:20.187407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-06da9bd9-1c3a-491f-ac7a-ddbde49a6399 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.157796 Sep 07 07:58:20.187958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 202/429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:20 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:20.454248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:20.455658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:20.461740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.462208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.462634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:20.463316 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.463764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.464212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:20.600730 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:20.608194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e87519e5-781d-489d-a9ec-21a6a169edaa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.157761 Sep 07 07:58:20.608755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 228/430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:20 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:20.774298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:20.774973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:20.781319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.781803 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.782234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:20.783015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.783524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.783947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:20.910225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:20.918665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:20.920104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:20.921242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-62ba3e5f-49e9-42f7-9a9d-a71dc1c29ebb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.150914 Sep 07 07:58:20.921790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 203/431] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:20 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:20.981408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:20.982073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:20.989298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.989790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.990226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:20.990916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:20.991375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:20.991804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.136227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:21.142280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:21.142771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:21.144840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e4e5ea3-22c7-4a81-aed0-1e996450fedb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.167360 Sep 07 07:58:21.145608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 229/432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:20 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:21.148669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.149147 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.149579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.150320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.150766 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.151181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.174013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3283b80a-411f-43cc-9b3b-1f3fdef7537c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/ips" status: 200 len: 147 microversion: 2.1 time: 0.035047 Sep 07 07:58:21.174551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 204/433] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 07:58:21 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:58:21.209707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:21.210308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:21.216166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.216643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.217069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.217747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.218197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.218615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.359120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:21.369216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ed07826-319f-47e1-ac11-48b9ac7d03d7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.163019 Sep 07 07:58:21.369831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 230/434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:21 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:21.631207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:21.631801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:21.637869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.638351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.638779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.639469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.639954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.640399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.875457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:21.883109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f4b05539-739a-4ec2-8544-558cd2684596 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1370 microversion: 2.1 time: 0.256534 Sep 07 07:58:21.883599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 205/435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:21 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:21.946179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:21.946777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:21.952757 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.953238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.953671 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:21.954346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:21.955480 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:21.955904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:22.087906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:22.097406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:22.098855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:22.100027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-286cf2f3-24ec-4a01-96d5-dfe0c09c1cc2 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.157790 Sep 07 07:58:22.100609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 231/436] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:21 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:22.167352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:22.167862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:22.174090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:22.174561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:22.174987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:22.175659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:22.176123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:22.176574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:22.319408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:22.327613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e833635a-475f-41b5-b4c7-c0b6ee900c5b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1751 microversion: 2.1 time: 0.164171 Sep 07 07:58:22.328194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 206/437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:22 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:22.392451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:22.393115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:22.395158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:22.400739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:22.401233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:22.402291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:22.403002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:22.403466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:22.403898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:22.538400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:22.546895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c9c08a80-3a71-46d8-bb60-31f7e556bfda tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.158526 Sep 07 07:58:22.547473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 232/438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:22 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:22.905359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:22.905954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:22.912507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:22.912988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:22.913424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:22.914111 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:22.914569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:22.914995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.049934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:23.057707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-722e1320-a764-4786-8897-26909f22383b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1564 microversion: 2.1 time: 0.156194 Sep 07 07:58:23.058261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 207/439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:22 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:23.080136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:23.080660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:23.087036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.087517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.087955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.088677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.089128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.089549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.126079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:23.127682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:23.133794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.134287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.134720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.135420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.135882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.136342 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.177401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b5f3041-4b66-4b9a-af2a-3809350366e5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101199 Sep 07 07:58:23.178750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 233/440] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 07:58:23 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:23.303613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:23.310552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:23.312958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:23.314406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-41d17514-f06d-4451-aa75-daabbcd5cbad tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.192934 Sep 07 07:58:23.328105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 208/441] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:23 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:23.350841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:23.351461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:23.357520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.358009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.358452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.359147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.359602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.360033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.570443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:23.571050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:23.589831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.590330 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.590770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.591482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:23.591941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:23.592391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:23.650297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:23.660030 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e13309fe-fbd7-4bd3-9813-92184bc09ae6 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.313095 Sep 07 07:58:23.660629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 234/442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:23 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:23.775882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:23.784802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-134f5c22-d4bf-420d-9e01-c0b8ba977fb4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.218219 Sep 07 07:58:23.785358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 209/443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:23 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:24.343628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:24.344290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:24.352603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.353307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.354063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.355095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.355704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.356472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.371711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9bbbc0e-167a-46ee-ab37-4ae6fdbc5032"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:24.374186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:24.381201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.381695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.382135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.382834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.385961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.386580 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.582782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:24.598579 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:24.600453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:24.601602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ddcce1fb-c339-48d4-96b9-10b560ab36e7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.263379 Sep 07 07:58:24.602162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 235/444] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:24 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:24.606871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b3210c79-1c30-4df1-baf2-0c4db62f93c3 req-98a24048-bb44-431e-9353-cf3785f8a201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4aca7e-3298-4cfa-9690-01676e2e1ab1", "tag": "3a3f0e9f-714c-4d7f-8738-852d6e45f0b5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:24.621852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b3210c79-1c30-4df1-baf2-0c4db62f93c3 req-98a24048-bb44-431e-9353-cf3785f8a201 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.622706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b3210c79-1c30-4df1-baf2-0c4db62f93c3 req-98a24048-bb44-431e-9353-cf3785f8a201 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.623352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b3210c79-1c30-4df1-baf2-0c4db62f93c3 req-98a24048-bb44-431e-9353-cf3785f8a201 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.636115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b3210c79-1c30-4df1-baf2-0c4db62f93c3 req-98a24048-bb44-431e-9353-cf3785f8a201 service nova] Creating event network-changed:3a3f0e9f-714c-4d7f-8738-852d6e45f0b5 for instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 on hv-cinder-83602 Sep 07 07:58:24.641184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b3210c79-1c30-4df1-baf2-0c4db62f93c3 req-98a24048-bb44-431e-9353-cf3785f8a201 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037776 Sep 07 07:58:24.641958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 236/445] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:24.685265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:24.685815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3bec2a1b-a5e4-4a3d-b0fe-826723f2869a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320016 Sep 07 07:58:24.686210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:24.693602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 210/446] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 07:58:24 2022] POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:58:24.694000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.694798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.695089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.695784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.696267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.696688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.810586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:24.811665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:24.820121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.821576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.822032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.823181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:24.823181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:24.823626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:24.864219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:24.872617 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d1f12b1-cd86-46b4-afe5-53b70ee4030c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.192331 Sep 07 07:58:24.873576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 237/447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:24 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:25.014137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:25.022123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6c6bee93-37b0-4152-af9d-5bf28880eaa9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.216349 Sep 07 07:58:25.022691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 211/448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:24 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:25.626816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:25.627426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:25.634123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:25.634615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:25.635053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:25.635786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:25.636272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:25.636701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:25.773643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:25.777082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:25.783524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:25.784963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:25.786244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c39f0211-42f6-4c03-9632-175fd0612fde tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.163371 Sep 07 07:58:25.786805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 238/449] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:25 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:25.896814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:25.897421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:25.903782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:25.904292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:25.904724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:25.905400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:25.905846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:25.906263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:26.045011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:26.045622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:26.052701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:26.053189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:26.053629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:26.054463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:26.054799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:26.055223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:26.056940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:26.065461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d1bf9652-845c-40a6-a353-6a84aeeab8d9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.172223 Sep 07 07:58:26.066092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 212/450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:25 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:26.209792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:26.219175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0cdbddd8-891d-4f7f-9393-68c989221b3c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.177947 Sep 07 07:58:26.232115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 239/451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:26 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:26.812588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:26.814431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:26.822497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:26.822982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:26.823418 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:26.824134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:26.824596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:26.825023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:26.962888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:26.972007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:26.973486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:26.974644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ff6fb765-b898-4556-bc15-72e8b1e8d932 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.166582 Sep 07 07:58:26.975197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 213/452] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:26 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:27.089233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:27.089839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:27.096391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:27.096869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:27.097303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:27.097978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:27.098426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:27.098842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:27.242681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:27.243320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:27.245735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:27.249281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:27.249764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:27.250197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:27.250882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:27.251982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:27.252544 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:27.254815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62e4d06d-d71e-49e3-a80e-be48fbe1dcec tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.169410 Sep 07 07:58:27.255390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 240/453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:27 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:27.386888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:27.394699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a35cfcfa-4c67-49e6-af9c-3d82de20d3ef tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.155883 Sep 07 07:58:27.395255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 214/454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:27 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:28.000600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:28.001199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:28.008329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:28.008806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:28.009237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:28.009918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:28.010452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:28.010880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:28.143057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:28.151494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:28.152957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:28.154089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a061c77-8a5a-462c-abf3-148a2861c82a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.157379 Sep 07 07:58:28.154644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 241/455] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:27 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:28.278755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:28.279280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:28.286258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:28.286737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:28.287167 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:28.287844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:28.288327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:28.288747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:28.416107 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:28.416920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:28.423005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:28.424169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:28.424709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:28.425464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:28.425925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:28.426484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:28.433820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:28.442350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5c9cd130-d944-4db2-9f54-c4261c084fae tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.167512 Sep 07 07:58:28.442920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 215/456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:28 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:28.563295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:28.571946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c5c9725-ae4b-4bae-ac6e-f910c5f8824b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.159723 Sep 07 07:58:28.572580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 242/457] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:28 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:29.178955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:29.179581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:29.185462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:29.185923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:29.186352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:29.187024 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:29.187471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:29.187888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:29.316484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:29.325277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:29.326732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:29.327878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f54bc79e-3d86-45d0-a698-e61c2ad199ce tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.152932 Sep 07 07:58:29.328458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 216/458] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:29 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:29.465203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:29.465835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:29.472307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:29.472786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:29.473211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:29.473886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:29.474332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:29.474747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:29.595572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:29.596227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:29.602116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:29.602594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:29.603026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:29.603708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:29.604179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:29.604600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:29.619562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:29.628538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be671b85-82cd-4172-a3ef-7855b8966726 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.167177 Sep 07 07:58:29.629108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 243/459] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:29 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:29.733964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:29.738013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:29.743178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f42f5c06-853f-4d54-acdb-74d734351c70 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.151593 Sep 07 07:58:29.743728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 217/460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:29 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:29.920260 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-65cbeab7-47aa-49eb-888e-fbc3893a33ac req-21f0c1cf-f827-49e0-877d-eacccd6a76a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bf06d0-30dc-4a08-94a4-bac302f07efb", "name": "network-vif-plugged", "status": "completed", "tag": "21b12ceb-ddd4-48f9-8f8c-e7c2fd169986"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:29.931576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-65cbeab7-47aa-49eb-888e-fbc3893a33ac req-21f0c1cf-f827-49e0-877d-eacccd6a76a2 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:29.932070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-65cbeab7-47aa-49eb-888e-fbc3893a33ac req-21f0c1cf-f827-49e0-877d-eacccd6a76a2 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:29.932611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-65cbeab7-47aa-49eb-888e-fbc3893a33ac req-21f0c1cf-f827-49e0-877d-eacccd6a76a2 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:29.944952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-65cbeab7-47aa-49eb-888e-fbc3893a33ac req-21f0c1cf-f827-49e0-877d-eacccd6a76a2 service nova] Creating event network-vif-plugged:21b12ceb-ddd4-48f9-8f8c-e7c2fd169986 for instance 86bf06d0-30dc-4a08-94a4-bac302f07efb on hv-cinder-83602 Sep 07 07:58:29.949936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-65cbeab7-47aa-49eb-888e-fbc3893a33ac req-21f0c1cf-f827-49e0-877d-eacccd6a76a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 Sep 07 07:58:29.950826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 244/461] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:30.354288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:30.354817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:30.362242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:30.362716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:30.363146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:30.363822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:30.364298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:30.364716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:30.504337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:30.513239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:30.514682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:30.515819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-56632c44-72cb-4d0e-a226-321f4926aaea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.165641 Sep 07 07:58:30.516440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 218/462] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:30 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:30.653456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:30.654169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:30.660905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:30.661395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:30.661834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:30.662525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:30.662986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:30.663415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:30.765483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:30.766191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:30.774288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:30.774806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:30.775246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:30.775955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:30.776443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:30.776865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:30.811172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:30.820828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-10b3ef0e-01da-447b-b961-0e4b73593f69 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.171502 Sep 07 07:58:30.821412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 245/463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:30 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:30.914593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:30.922180 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-75c085d4-7ff2-433d-a7e2-2726c73471fc tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.160574 Sep 07 07:58:30.922733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 219/464] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:30 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:31.541553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:31.542157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:31.549103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:31.549584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:31.550015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:31.550692 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:31.551140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:31.551556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:31.679013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:31.687681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:31.689160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:31.690556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-54cba344-7bef-41e4-b722-af0829ce462a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.152823 Sep 07 07:58:31.691117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 246/465] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:31 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:31.843228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:31.843827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:31.851096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:31.851579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:31.852008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:31.852730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:31.853177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:31.853595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:31.950051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:31.950917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:31.961602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:31.962101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:31.962532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:31.963233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:31.963690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:31.964122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:32.009633 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:32.020594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-47edc3ec-705c-417a-be18-57dafb49cd21 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.180934 Sep 07 07:58:32.021177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 220/466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:31 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:32.105169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:32.113043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-493f49b0-3aec-451f-aac6-7ff1f2c263ff tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.170699 Sep 07 07:58:32.113610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 247/467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:31 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:32.716309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:32.716916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:32.723608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:32.724167 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:32.724550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:32.725233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:32.725680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:32.726097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:32.861453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:32.870218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:32.871667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:32.872851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fe012e6a-affe-49ec-bc33-6614e317572c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1809 microversion: 2.20 time: 0.160502 Sep 07 07:58:32.873404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 221/468] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:32 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:33.045302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:33.045984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:33.053340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:33.053800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:33.054231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:33.054923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:33.055377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:33.055797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:33.136892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:33.137626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:33.145490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:33.146075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:33.146758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:33.147465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:33.147976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:33.148591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:33.207974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:33.216489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c95365c-3667-4b31-a466-de7e67def17d tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.174992 Sep 07 07:58:33.217253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 248/469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:33 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:33.289522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:33.297281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7a98525b-dc2e-4d07-9dab-6e095d99bb22 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.164209 Sep 07 07:58:33.297861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 222/470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:33 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:33.898881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:33.899421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:33.905479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:33.905957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:33.906391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:33.907078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:33.907538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:33.907963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:34.041564 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:34.051568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:34.053170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:34.054440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98cffa6d-44e7-425f-8f46-a06685bf4d24 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1796 microversion: 2.20 time: 0.159511 Sep 07 07:58:34.055123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 249/471] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:58:33 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1796 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:58:34.087998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-38e26436-7b5f-4465-a806-a3bb14fae9d2 req-16c0529d-1ab2-43b7-bb26-ea6644b10c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a500c169-e521-4f76-b825-f3c52a0583fb", "name": "network-vif-plugged", "status": "completed", "tag": "ccdaaab5-715d-42e0-bff3-ea1b67a8f356"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:34.098845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-38e26436-7b5f-4465-a806-a3bb14fae9d2 req-16c0529d-1ab2-43b7-bb26-ea6644b10c81 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:34.099932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-38e26436-7b5f-4465-a806-a3bb14fae9d2 req-16c0529d-1ab2-43b7-bb26-ea6644b10c81 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:34.100406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-38e26436-7b5f-4465-a806-a3bb14fae9d2 req-16c0529d-1ab2-43b7-bb26-ea6644b10c81 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:34.112624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-38e26436-7b5f-4465-a806-a3bb14fae9d2 req-16c0529d-1ab2-43b7-bb26-ea6644b10c81 service nova] Creating event network-vif-plugged:ccdaaab5-715d-42e0-bff3-ea1b67a8f356 for instance a500c169-e521-4f76-b825-f3c52a0583fb on hv-cinder-83602 Sep 07 07:58:34.117372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-38e26436-7b5f-4465-a806-a3bb14fae9d2 req-16c0529d-1ab2-43b7-bb26-ea6644b10c81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Sep 07 07:58:34.117951 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 223/472] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:34.241382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:34.242186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:34.250225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:34.250724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:34.251279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:34.252721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:34.253338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:34.253782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:34.320981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:34.321908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:34.328321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:34.328845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:34.329624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:34.330668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:34.331201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:34.331728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:34.416950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:34.426324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-78fe54ee-8359-47d3-887b-59dc2f4fe1e9 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.190531 Sep 07 07:58:34.436565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 250/473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:34 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:34.482255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:34.491292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-718e02df-db6b-4bdd-b1c5-0aa3d4917c7f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.174756 Sep 07 07:58:34.491868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 224/474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:34 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:35.437141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4737cef-8220-47a4-93fe-07313bb65371 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:35.444591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4737cef-8220-47a4-93fe-07313bb65371 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:35.445077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4737cef-8220-47a4-93fe-07313bb65371 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:35.445539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4737cef-8220-47a4-93fe-07313bb65371 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:35.450486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:35.451092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:35.457646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:35.458132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:35.458563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:35.459243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:35.459694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:35.460133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:35.506222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4737cef-8220-47a4-93fe-07313bb65371 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Going to try to stop instance {{(pid=120494) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 07:58:35.552028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4737cef-8220-47a4-93fe-07313bb65371 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action" status: 202 len: 0 microversion: 2.1 time: 0.118525 Sep 07 07:58:35.552697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 251/475] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:58:35 2022] POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:58:35.557946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:35.558643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:35.565764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:35.566331 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:35.566843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:35.567503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:35.567958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:35.568439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:35.608992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:35.617771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83d2c288-c6b0-41be-a11f-95b316e15afd tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.171006 Sep 07 07:58:35.618335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 225/476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:35 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:35.622874 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:35.623626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:35.630420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:35.631114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:35.631698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:35.632677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:35.633242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:35.633765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:35.710287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:35.718165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-03570d4c-3a18-456f-964d-9c433313f316 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1258 microversion: 2.1 time: 0.164342 Sep 07 07:58:35.718744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 252/477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:35 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:35.767249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:35.775481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ca3f1827-9ddb-4c1d-8a8f-96c543691e23 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.156049 Sep 07 07:58:35.776047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 226/478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:35 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:36.640901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:36.641409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:36.648451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.648928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.649358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.650037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.650512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.650931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.741609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:36.742257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:36.748558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.749015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.749442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.750123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.750579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.751577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.792993 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:36.801999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65f178dc-165d-459d-ab94-976c313e8389 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.164948 Sep 07 07:58:36.802660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 253/479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:36 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:36.807139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:36.807805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:36.814224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.814789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.815390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.816100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.816562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.816984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.886156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:36.894397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ebb389ff-5c7a-42da-a464-617c4aeef8ab tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1443 microversion: 2.1 time: 0.156557 Sep 07 07:58:36.894902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 227/480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:36 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:36.916293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:36.916892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:36.923249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.923745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.924302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.924991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:36.925442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:36.925862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:36.952517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:36.961128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-de36e703-85f4-4d1e-aaa4-1a3ed035b9ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.157431 Sep 07 07:58:36.961699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 254/481] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:36 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:37.056482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:37.064690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-60afe313-c1a0-429c-b65d-35adce45171b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1443 microversion: 2.1 time: 0.152136 Sep 07 07:58:37.065506 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 228/482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:36 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:37.826148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:37.826742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:37.833093 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:37.833563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:37.833991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:37.834679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:37.835128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:37.835547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:37.839670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:37.986717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:37.994279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:37.995052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:37.996454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8075a1e9-b821-49e1-bdc4-b826671637f4 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.174184 Sep 07 07:58:37.997218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 255/483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:37 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:38.001515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:38.002005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:38.002433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:38.003130 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:38.003611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:38.004032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:38.408452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:38.416926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-feb7c47a-93b5-4e17-8b22-c773a058148e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.436207 Sep 07 07:58:38.417679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 229/484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:37 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:39.021521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:39.022102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:39.028655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:39.029134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:39.029612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:39.030438 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:39.030919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:39.031727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:39.106099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-e212b186-850a-484c-bec7-b6e7a5735bd1 req-ac3816f2-caa0-43e1-af18-d5d7205b0f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a500c169-e521-4f76-b825-f3c52a0583fb", "tag": "ccdaaab5-715d-42e0-bff3-ea1b67a8f356"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:39.117118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-e212b186-850a-484c-bec7-b6e7a5735bd1 req-ac3816f2-caa0-43e1-af18-d5d7205b0f07 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:39.117617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-e212b186-850a-484c-bec7-b6e7a5735bd1 req-ac3816f2-caa0-43e1-af18-d5d7205b0f07 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:39.118035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-e212b186-850a-484c-bec7-b6e7a5735bd1 req-ac3816f2-caa0-43e1-af18-d5d7205b0f07 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:39.131812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-e212b186-850a-484c-bec7-b6e7a5735bd1 req-ac3816f2-caa0-43e1-af18-d5d7205b0f07 service nova] Creating event network-changed:ccdaaab5-715d-42e0-bff3-ea1b67a8f356 for instance a500c169-e521-4f76-b825-f3c52a0583fb on hv-cinder-83602 Sep 07 07:58:39.137714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-e212b186-850a-484c-bec7-b6e7a5735bd1 req-ac3816f2-caa0-43e1-af18-d5d7205b0f07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035380 Sep 07 07:58:39.138515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 230/485] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:39.204808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:39.213994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f18bbccb-c1ed-461f-8e10-70d1e489c161 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1756 microversion: 2.1 time: 0.197073 Sep 07 07:58:39.214579 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 256/486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:39 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:39.441341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:39.442028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:39.448071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:39.448576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:39.449006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:39.449689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:39.450137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:39.450560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:39.588696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:39.597545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aa2157ee-ea5f-418e-8d74-2c2a643b28f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.161361 Sep 07 07:58:39.598110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 231/487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:39 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:40.238201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:40.238738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:40.245232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:40.245710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:40.246140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:40.246827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:40.247277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:40.247693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:40.398860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:40.407537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-64724d54-1a8b-4f1f-b882-883da7ecc61b tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1759 microversion: 2.1 time: 0.172821 Sep 07 07:58:40.408213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 257/488] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:40 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:40.621393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:40.621935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:40.628500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:40.628981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:40.629416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:40.630098 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:40.630582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:40.631007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:40.763018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:40.772119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-11cacc60-33cf-4320-b022-fd70407f139d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.154822 Sep 07 07:58:40.772680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 232/489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:40 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:41.794783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:41.795386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:41.802664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:41.803147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:41.803580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:41.804289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:41.804742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:41.805160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:41.939402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:41.947831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-11f3694a-1c44-40a0-8115-2ff44f08cdfd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.156866 Sep 07 07:58:41.948429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 258/490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:41 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:42.971255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:42.971881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:42.974435 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=91 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:42.979464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:42.979940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:42.980402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:42.981092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:42.981537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:42.981953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:43.113806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:43.122072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-94d8b934-b4ef-4b3b-8497-942c90af5523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.154828 Sep 07 07:58:43.122639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 233/491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:42 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:44.147226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:44.147836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:44.154375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:44.154858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:44.155293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:44.155974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:44.156456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:44.156982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:44.285783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:44.294127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65836c8a-6465-47f9-8721-db26498f358d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.150738 Sep 07 07:58:44.294737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 259/492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:44 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:45.318685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:45.319293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:45.325747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:45.326227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:45.326663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:45.327345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:45.327798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:45.328310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:45.464735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:45.473468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-96e93703-1a44-432b-8e55-c0a840e91a95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.159264 Sep 07 07:58:45.473973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 234/493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:45 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:46.497427 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:46.498032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:46.504994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:46.505473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:46.505907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:46.506589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:46.507036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:46.507457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:46.646474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:46.654513 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e08fad20-8942-4bd7-bedf-0367a4cc4982 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.160926 Sep 07 07:58:46.655075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 260/494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:46 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:47.677676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:47.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:47.684609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:47.685080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:47.685505 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:47.686178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:47.686625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:47.687042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:47.817482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:47.820894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:47.826250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d1fb6e19-c219-4c5d-9213-a5d3395f8998 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.152508 Sep 07 07:58:47.826804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 235/495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:47 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:48.850272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:48.851012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:48.857238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:48.857723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:48.858157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:48.858853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:48.859306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:48.859774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:49.004982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:49.013156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-efbf1230-c552-4818-bf61-a7f0f79f0574 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.166882 Sep 07 07:58:49.013718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 261/496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:48 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:58:50.037190 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:50.037792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:50.044601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:50.045088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:50.045522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:50.046205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:50.046661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:50.047092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:50.178405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:50.186437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9e01f44f-7019-4bb5-bbaf-3798b528c28e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.153570 Sep 07 07:58:50.186995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 236/497] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:50 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:51.210649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:51.211258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:51.218119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:51.218603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:51.219763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:51.220493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:51.220986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:51.221412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:51.349077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:51.357335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-969d069c-974f-40d1-b267-cd9dab844d4c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1725 microversion: 2.1 time: 0.150596 Sep 07 07:58:51.357905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 262/498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:51 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:52.380215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:52.380827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:52.387254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:52.387733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:52.388206 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:52.388894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:52.389343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:52.389763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:52.516050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:52.524287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-94afdce7-0bac-446b-bc9b-c7af13773be1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1702 microversion: 2.1 time: 0.147949 Sep 07 07:58:52.524872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 237/499] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:52 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1702 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:52.547706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d88342e0-3ba2-47d5-bff8-c54e5f6496df tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:52.550196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=62 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:58:52.555333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d88342e0-3ba2-47d5-bff8-c54e5f6496df tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:52.555809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d88342e0-3ba2-47d5-bff8-c54e5f6496df tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:52.556284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d88342e0-3ba2-47d5-bff8-c54e5f6496df tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:52.578271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d88342e0-3ba2-47d5-bff8-c54e5f6496df tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Going to try to start instance {{(pid=120494) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 07:58:52.618231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d88342e0-3ba2-47d5-bff8-c54e5f6496df tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action" status: 202 len: 0 microversion: 2.1 time: 0.074797 Sep 07 07:58:52.618817 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 263/500] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:58:52 2022] POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:58:52.626749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:52.627349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:52.633302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:52.633724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:52.634159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:52.634844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:52.635291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:52.635713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:52.766675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:52.775224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b781c13-4552-4bd5-a304-7eb3551cfbe8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1711 microversion: 2.1 time: 0.152236 Sep 07 07:58:52.775799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 238/501] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:52 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1711 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:53.800633 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:53.801245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:53.807344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:53.807820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:53.808287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:53.808964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:53.809437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:53.809834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:53.940973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:53.949151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d4f36b3-c86b-45a8-89ff-e927b1c3e256 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1711 microversion: 2.1 time: 0.154039 Sep 07 07:58:53.949724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 264/502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:53 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:54.972451 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:54.973057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:54.979585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:54.980061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:54.980520 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:54.981200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:54.981649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:54.982069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:55.118678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:55.127683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7cd54cc2-e862-4c63-85dc-4ac72568160b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1715 microversion: 2.1 time: 0.159400 Sep 07 07:58:55.128280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 239/503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:54 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:58:59.242846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:59.243410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:59.249833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.250439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.251023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.251711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.252201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.252629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.277014 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6775e7ed-efc4-43fd-a87e-8bc72c3639c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b/ips" status: 200 len: 151 microversion: 2.1 time: 0.038076 Sep 07 07:58:59.277570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 265/504] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 07:58:59 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:58:59.289649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47af907f-25c4-4f52-a9ea-9feec8d5313d"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:58:59.292014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:59.299326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.299813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.300286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.300980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.301474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.301902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.382490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Invalid volume: volume 47af907f-25c4-4f52-a9ea-9feec8d5313d is already attached to instances: 6f3a1e65-1d0a-4462-928c-e0b7610c2180 Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: POST /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b/os-volume_attachments HTTP/1.1 Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 74 Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 07:58:59.386521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {"volumeAttachment": {"volumeId": "47af907f-25c4-4f52-a9ea-9feec8d5313d"}} Sep 07 07:58:59.388161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Invalid volume: volume 47af907f-25c4-4f52-a9ea-9feec8d5313d is already attached to instances: 6f3a1e65-1d0a-4462-928c-e0b7610c2180 Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'server_id': 'f6a6fa25-3c84-48c7-a503-524e02cbb19b', 'body': {'volumeAttachment': {'volumeId': '47af907f-25c4-4f52-a9ea-9feec8d5313d'}}} Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 47af907f-25c4-4f52-a9ea-9feec8d5313d is already attached to instances: 6f3a1e65-1d0a-4462-928c-e0b7610c2180 Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:58:59.389249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 47af907f-25c4-4f52-a9ea-9feec8d5313d is already attached to instances: 6f3a1e65-1d0a-4462-928c-e0b7610c2180 Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:58:59.391224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 47af907f-25c4-4f52-a9ea-9feec8d5313d is already attached to instances: 6f3a1e65-1d0a-4462-928c-e0b7610c2180 Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 400 to user: Invalid volume: volume 47af907f-25c4-4f52-a9ea-9feec8d5313d is already attached to instances: 6f3a1e65-1d0a-4462-928c-e0b7610c2180 {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-18016e2b-c9b6-4757-af70-c3ea8fbfb6c4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102353 Sep 07 07:58:59.392775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 240/505] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 07:58:59 2022] POST /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 07:58:59.397969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:59.398546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:59.404968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.405673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.407098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.407863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.408423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.408916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.433668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 07:58:59.517199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-31b555b5-7109-4bc5-9ea2-abc7490a330e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 204 len: 0 microversion: 2.1 time: 0.122727 Sep 07 07:58:59.517812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 266/506] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 07:58:59 2022] DELETE /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 07:58:59.526103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:58:59.526952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:58:59.534069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.534549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.534976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.535656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:58:59.536129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:58:59.536551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:58:59.665086 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:58:59.673115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-619d0953-fbb4-4b7a-8e60-90b7d8328fef tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1680 microversion: 2.1 time: 0.150945 Sep 07 07:58:59.673673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 241/507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:58:59 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:00.697190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:00.699104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:00.706201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:00.706685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:00.707121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:00.707814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:00.708293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:00.708715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:00.838618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:00.846352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b582226-3f9c-4685-b901-594177440b77 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1680 microversion: 2.1 time: 0.153500 Sep 07 07:59:00.846912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 267/508] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:00 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:01.869534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:01.870145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:01.876776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:01.877258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:01.877692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:01.878381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:01.878838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:01.879265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:02.154821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:02.162464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4b101a51-cf69-4da1-af1f-f461fe7ce65d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1680 microversion: 2.1 time: 0.296834 Sep 07 07:59:02.163027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 242/509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:01 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1680 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:02.549536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4e5a721c-7264-4e52-8328-320e7c0b0413 req-9f96bf55-00cf-4eea-91e7-f4b7d7abd556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a6fa25-3c84-48c7-a503-524e02cbb19b", "name": "network-vif-deleted", "tag": "bf926a4a-8baa-4366-9fa1-db0fa2688aa2"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:02.559923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e5a721c-7264-4e52-8328-320e7c0b0413 req-9f96bf55-00cf-4eea-91e7-f4b7d7abd556 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:02.560466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e5a721c-7264-4e52-8328-320e7c0b0413 req-9f96bf55-00cf-4eea-91e7-f4b7d7abd556 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:02.560894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4e5a721c-7264-4e52-8328-320e7c0b0413 req-9f96bf55-00cf-4eea-91e7-f4b7d7abd556 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:02.575395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4e5a721c-7264-4e52-8328-320e7c0b0413 req-9f96bf55-00cf-4eea-91e7-f4b7d7abd556 service nova] Creating event network-vif-deleted:bf926a4a-8baa-4366-9fa1-db0fa2688aa2 for instance f6a6fa25-3c84-48c7-a503-524e02cbb19b on hv-cinder-83602 Sep 07 07:59:02.581617 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4e5a721c-7264-4e52-8328-320e7c0b0413 req-9f96bf55-00cf-4eea-91e7-f4b7d7abd556 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Sep 07 07:59:02.582576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 268/510] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:03.186416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:03.187980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:03.195903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:03.196654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:03.197087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:03.197940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:03.198565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:03.199143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:03.236770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:03.237253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:03.237686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:03.238257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lazy-loading 'fault' on Instance uuid f6a6fa25-3c84-48c7-a503-524e02cbb19b {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:03.300153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:03.308067 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9811f8ef-f5eb-4d53-9edd-2d48a129abf4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 200 len: 1329 microversion: 2.1 time: 0.125649 Sep 07 07:59:03.308849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 243/511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:03 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 1329 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:04.332436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:04.333224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:04.340247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:04.340829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:04.341359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:04.342136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:04.342660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:04.343168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:04.357485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b HTTP/1.1 Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:59:04.359698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 07:59:04.361391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'f6a6fa25-3c84-48c7-a503-524e02cbb19b'} Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:59:04.362177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 07:59:04.363338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:04.364425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:59:04.364425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fce13a59-a9a5-448b-aee1-2ab0b6f17dcc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 404 len: 111 microversion: 2.1 time: 0.033976 Sep 07 07:59:04.364425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 269/512] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:04 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 07:59:04.370442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e87781ca-4c96-4d0a-b187-77f82afb9048 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '.version_select at 0x7f831ec29dc0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:04.396244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e87781ca-4c96-4d0a-b187-77f82afb9048 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89093674" status: 202 len: 0 microversion: 2.1 time: 0.029610 Sep 07 07:59:04.400187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 244/513] 10.222.0.26 () {58 vars in 1215 bytes} [Wed Sep 7 07:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89093674 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:59:05.305492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:05.305931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:05.311860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:05.312416 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:05.312958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:05.313647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:05.314104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:05.314783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:05.434512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:05.439931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lazy-loading 'services' on Instance uuid 6f3a1e65-1d0a-4462-928c-e0b7610c2180 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:05.554291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-653bd1eb-3c6c-419f-9001-221030358312 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments/47af907f-25c4-4f52-a9ea-9feec8d5313d" status: 202 len: 0 microversion: 2.1 time: 0.252590 Sep 07 07:59:05.554902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 270/514] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 07:59:05 2022] DELETE /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments/47af907f-25c4-4f52-a9ea-9feec8d5313d => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:59:05.564467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:05.566877 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:05.572897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:05.573375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:05.573876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:05.574575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:05.575026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:05.575452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:05.606940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2140c7f1-d688-47e9-989c-511296c8d9a0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047492 Sep 07 07:59:05.607498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 245/515] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:59:05 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:06.621597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:06.623892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:06.630660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:06.631144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:06.631582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:06.632311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:06.632772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:06.633201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:06.662874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cc770e4-011b-47aa-99a5-d9a7ac2eeaee tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Sep 07 07:59:06.663354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 271/516] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:59:06 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:07.675483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:07.677575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:07.684105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:07.684587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:07.685015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:07.685715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:07.686161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:07.686578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:07.715179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8def1461-8db5-4db2-947b-34dfd2bff27a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043988 Sep 07 07:59:07.715707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 246/517] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:59:07 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 07:59:07.777775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:07.778274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:07.785305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:07.785781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:07.786210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:07.786884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:07.787335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:07.787758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:07.812257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 07:59:07.886289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d47bcfc-3e7d-44ba-9ed1-b5e015d77c78 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 204 len: 0 microversion: 2.1 time: 0.112035 Sep 07 07:59:07.886866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 272/518] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 07:59:07 2022] DELETE /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 07:59:07.896450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:07.897063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:07.903038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:07.903519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:07.903950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:07.904661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:07.905115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:07.905548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:08.035944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:08.043633 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e901eeba-f461-4eef-86f1-d270fdb02ea7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1682 microversion: 2.1 time: 0.151242 Sep 07 07:59:08.044220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 247/519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:07 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:09.068023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:09.068748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:09.075452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:09.075931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:09.076400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:09.077080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:09.077526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:09.078465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:09.209029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:09.216767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2909b205-805a-4ef3-a32c-434dd63bc251 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1682 microversion: 2.1 time: 0.153427 Sep 07 07:59:09.217332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 273/520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:09 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:10.241166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:10.241815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:10.248390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:10.248875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:10.249318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:10.250279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:10.250888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:10.251320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:10.491099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:10.498222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f8275dde-26eb-4129-b08d-9c68e99a9053 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1682 microversion: 2.1 time: 0.261020 Sep 07 07:59:10.498804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 248/521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:10 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:11.143005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-02898235-1e52-4a86-85b4-0ea099e8b579 req-5bb20bcf-455a-46ce-a6c4-c6dd4fdd932e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3a1e65-1d0a-4462-928c-e0b7610c2180", "name": "network-vif-deleted", "tag": "d3200a8b-180c-48b9-b687-e420d53e9630"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:11.152974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-02898235-1e52-4a86-85b4-0ea099e8b579 req-5bb20bcf-455a-46ce-a6c4-c6dd4fdd932e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:11.153408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-02898235-1e52-4a86-85b4-0ea099e8b579 req-5bb20bcf-455a-46ce-a6c4-c6dd4fdd932e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:11.154467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-02898235-1e52-4a86-85b4-0ea099e8b579 req-5bb20bcf-455a-46ce-a6c4-c6dd4fdd932e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:11.165306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-02898235-1e52-4a86-85b4-0ea099e8b579 req-5bb20bcf-455a-46ce-a6c4-c6dd4fdd932e service nova] Creating event network-vif-deleted:d3200a8b-180c-48b9-b687-e420d53e9630 for instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 on hv-cinder-83602 Sep 07 07:59:11.170032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-02898235-1e52-4a86-85b4-0ea099e8b579 req-5bb20bcf-455a-46ce-a6c4-c6dd4fdd932e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 Sep 07 07:59:11.170796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 274/522] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:11.520908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:11.521525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:11.528245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:11.528736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:11.529238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:11.529941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:11.530396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:11.530922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:11.564975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:11.565464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:11.565902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:11.566421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lazy-loading 'fault' on Instance uuid 6f3a1e65-1d0a-4462-928c-e0b7610c2180 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:11.615387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:11.623561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7121c569-34ac-433e-b9cf-eb6c1cad2a5e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 200 len: 1331 microversion: 2.1 time: 0.106533 Sep 07 07:59:11.625490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 249/523] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:11 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:12.648858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:12.649590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:12.656425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:12.657019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:12.657464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:12.658154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:12.658614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:12.659046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:12.672778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 HTTP/1.1 Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:59:12.674386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 07:59:12.675833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '6f3a1e65-1d0a-4462-928c-e0b7610c2180'} Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:59:12.676792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 07:59:12.678208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:12.679472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:59:12.679472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17431150-5ea6-4050-af18-bda7a2c8501d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 404 len: 111 microversion: 2.1 time: 0.031736 Sep 07 07:59:12.679472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 275/524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:12 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 07:59:12.684547 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-61378e04-3092-4ea2-8cc9-941dc11a63c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '.version_select at 0x7f83202fe1f0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:12.703938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-61378e04-3092-4ea2-8cc9-941dc11a63c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136022875" status: 202 len: 0 microversion: 2.1 time: 0.023183 Sep 07 07:59:12.704524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 250/525] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Sep 7 07:59:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136022875 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 07:59:13.341354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f5e1f39-93a9-4ade-8438-a53feae8ebc3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: .version_select at 0x7f831e8f0940>, body: {"keypair": {"name": "tempest-keypair-1656529207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcf+HkfWlTcp+ZRZDA2+5KMCRyyRbs4RT6OX5RBJqPW650VtU1NSDZrJYFzgadU20UsB2qKFQuTJcweugfhA17K8oIZeWoQtsS/burSLtHz+M1+8CJz0XqoPN26s95s2Q=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:13.356514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-0f5e1f39-93a9-4ade-8438-a53feae8ebc3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:59:13.360422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-0f5e1f39-93a9-4ade-8438-a53feae8ebc3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:59:13.382246 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f5e1f39-93a9-4ade-8438-a53feae8ebc3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044620 Sep 07 07:59:13.383153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 276/526] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 07:59:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:14.600523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-611379698", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d7d7a39-e6a6-423e-b552-9ec48c064b08"}], "security_groups": [{"name": "tempest-securitygroup--1333901789"}], "key_name": "tempest-keypair-1656529207", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:14.611943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:14.711883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] validate_networks() for [('3d7d7a39-e6a6-423e-b552-9ec48c064b08', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:59:15.101824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:59:15.102402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:59:15.103274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:59:15.103962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:59:15.104435 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:59:15.114003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:15.114534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:15.115013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:15.115743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:15.116250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:15.116671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:15.134787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:59:15.138811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:59:15.152541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:59:15.154778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:59:15.211117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b95a0ad9-5067-401e-bc81-921ab89a7665 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.615270 Sep 07 07:59:15.211976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 251/527] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 07:59:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 07:59:15.224822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f91f504-7dc5-4923-9f7d-b84cad80959b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:15.225426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f91f504-7dc5-4923-9f7d-b84cad80959b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:15.290261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f91f504-7dc5-4923-9f7d-b84cad80959b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:15.297164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f91f504-7dc5-4923-9f7d-b84cad80959b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1241 microversion: 2.1 time: 0.076829 Sep 07 07:59:15.297736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 277/528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:15 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:16.325327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:16.325857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:16.331987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:16.332556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:16.332991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:16.333669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:16.334116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:16.334551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:16.397778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:16.405242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3974d3e9-275b-4db2-b927-d79365a729c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1293 microversion: 2.1 time: 0.084386 Sep 07 07:59:16.406577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 252/529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:16 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:17.428673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:17.429283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:17.435806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:17.436341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:17.436778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:17.437477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:17.437930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:17.438351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:17.501215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:17.509154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3f5417c-18c4-4af9-9f1c-d4893cd81b4a tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1299 microversion: 2.1 time: 0.084327 Sep 07 07:59:17.509724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 278/530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:17 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:18.285512 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-f6ad8393-c5fb-484a-ab62-9a91c35009f1 req-1ceeecc5-1ad5-4c82-82f5-9642eee7f4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6296be2b-713c-4cc7-9c5e-6ddd1388bdab", "tag": "687b7420-4dbb-4f01-84f0-5827ccae5ed3"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:18.295462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f6ad8393-c5fb-484a-ab62-9a91c35009f1 req-1ceeecc5-1ad5-4c82-82f5-9642eee7f4fb service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:18.296224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f6ad8393-c5fb-484a-ab62-9a91c35009f1 req-1ceeecc5-1ad5-4c82-82f5-9642eee7f4fb service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:18.296542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f6ad8393-c5fb-484a-ab62-9a91c35009f1 req-1ceeecc5-1ad5-4c82-82f5-9642eee7f4fb service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:18.307049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-f6ad8393-c5fb-484a-ab62-9a91c35009f1 req-1ceeecc5-1ad5-4c82-82f5-9642eee7f4fb service nova] Creating event network-changed:687b7420-4dbb-4f01-84f0-5827ccae5ed3 for instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab on hv-cinder-83602 Sep 07 07:59:18.311896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-f6ad8393-c5fb-484a-ab62-9a91c35009f1 req-1ceeecc5-1ad5-4c82-82f5-9642eee7f4fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030940 Sep 07 07:59:18.312498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 253/531] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:18.532974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:18.533666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:18.539650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:18.540161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:18.540592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:18.541270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:18.541714 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:18.542130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:18.678322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:18.686533 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e329ae20-7f7a-4e0d-8841-73084f3200a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1367 microversion: 2.1 time: 0.157428 Sep 07 07:59:18.687980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 279/532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:18 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:19.710676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:19.711366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:19.717519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:19.718735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:19.719180 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:19.719859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:19.720352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:19.720774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:19.853844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:19.861628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4cebff71-534e-4b46-9773-e6f46b635db0 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1367 microversion: 2.1 time: 0.155593 Sep 07 07:59:19.862208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 254/533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:19 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:20.363479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fee1d37-6c38-4421-a1b4-781f54ac7081"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:20.365769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:20.372169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:20.372652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:20.373085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:20.373768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:20.374892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:20.375304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:20.884224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:20.884968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:20.891716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:20.892253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:20.892676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:20.893377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:20.893830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:20.894255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:20.896993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=99 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:21.021653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd6525dd-7c87-4e20-980b-11a375e49d35 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662755 Sep 07 07:59:21.022697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 280/534] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 07:59:20 2022] POST /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:21.042576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:21.051146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-44388537-7f7e-4c00-b477-e8fb8b82c0e8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1367 microversion: 2.1 time: 0.171072 Sep 07 07:59:21.051710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 255/535] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:20 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:22.075305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:22.076007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:22.083003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.083485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.083921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.084639 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.085094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.085549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.125169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:22.128557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:22.135198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.136171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.136872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.137924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.138576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.139065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.172608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-173ecf1c-5cf7-4942-9259-3623802734a1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments/314a6666-641c-416e-81a4-20398fa758f3" status: 200 len: 194 microversion: 2.20 time: 0.056121 Sep 07 07:59:22.173396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 256/536] 10.222.0.26 () {60 vars in 1454 bytes} [Wed Sep 7 07:59:22 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments/314a6666-641c-416e-81a4-20398fa758f3 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:59:22.224755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:22.233185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a9cf2f3-c6f2-4509-90bc-13810e56a0bb tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1367 microversion: 2.1 time: 0.162504 Sep 07 07:59:22.233838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 281/537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:22 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:22.250031 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:22.250558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:22.256694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.257179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.257609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.258292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.258745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.259163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.388537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lazy-loading 'services' on Instance uuid 86bf06d0-30dc-4a08-94a4-bac302f07efb {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:22.504068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5fda4e05-36d5-404b-b810-739a596b194d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments/314a6666-641c-416e-81a4-20398fa758f3" status: 202 len: 0 microversion: 2.20 time: 0.258295 Sep 07 07:59:22.504671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 257/538] 10.222.0.26 () {60 vars in 1457 bytes} [Wed Sep 7 07:59:22 2022] DELETE /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments/314a6666-641c-416e-81a4-20398fa758f3 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 07:59:22.513046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:22.516063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:22.522855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.523464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.523903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.524710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:22.525237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:22.525664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:22.556324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e029b28-f2e9-4dbc-947e-4e7421e0627f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047164 Sep 07 07:59:22.556867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 282/539] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:22 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:59:23.256939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:23.257563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:23.263639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:23.264149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:23.264595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:23.265329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:23.265782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:23.266209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:23.395628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:23.403244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d5cdd97c-15f7-49a1-8927-7e7e6d408bc9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1367 microversion: 2.1 time: 0.151108 Sep 07 07:59:23.403800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 258/540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:23 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:23.569486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:23.571535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:23.574053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:23.579832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:23.580347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:23.580791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:23.581484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:23.581944 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:23.582371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:23.613461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cd5f803-e8e8-4e10-8d4f-ff770b31dd9a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048022 Sep 07 07:59:23.614018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 283/541] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:23 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:59:24.376793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-3797a2c2-64dd-4ec6-9482-ce189e042991 req-32785dcc-0c1b-4431-bab8-4a079482294b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6296be2b-713c-4cc7-9c5e-6ddd1388bdab", "name": "network-vif-plugged", "status": "completed", "tag": "687b7420-4dbb-4f01-84f0-5827ccae5ed3"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:24.391282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3797a2c2-64dd-4ec6-9482-ce189e042991 req-32785dcc-0c1b-4431-bab8-4a079482294b service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:24.391949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3797a2c2-64dd-4ec6-9482-ce189e042991 req-32785dcc-0c1b-4431-bab8-4a079482294b service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:24.392425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3797a2c2-64dd-4ec6-9482-ce189e042991 req-32785dcc-0c1b-4431-bab8-4a079482294b service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:24.405832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-3797a2c2-64dd-4ec6-9482-ce189e042991 req-32785dcc-0c1b-4431-bab8-4a079482294b service nova] Creating event network-vif-plugged:687b7420-4dbb-4f01-84f0-5827ccae5ed3 for instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab on hv-cinder-83602 Sep 07 07:59:24.410779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-3797a2c2-64dd-4ec6-9482-ce189e042991 req-32785dcc-0c1b-4431-bab8-4a079482294b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038651 Sep 07 07:59:24.411528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 259/542] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:24.427016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:24.427626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:24.435219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:24.435704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:24.436165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:24.437561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:24.438191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:24.438767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:24.584568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:24.593203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b36a7f32-52f7-4258-906e-ef9ca2c5f243 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1367 microversion: 2.1 time: 0.169769 Sep 07 07:59:24.593771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 284/543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:24 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:24.626666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:24.629046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:24.635285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:24.635780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:24.636258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:24.636957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:24.637420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:24.637849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:24.667906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-53626a8f-16b5-47a6-8bde-8ee2026480ea tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045540 Sep 07 07:59:24.668492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 260/544] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:24 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:59:25.615899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:25.616563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:25.618558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:25.626922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:25.627422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:25.627865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:25.628926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:25.629681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:25.630047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:25.681132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:25.683277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:25.685280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:25.686002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:25.693301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:25.693786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:25.694216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:25.694910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:25.695367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:25.695787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:25.725566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-81d6fa47-c178-46bc-bff1-e544735513ab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048443 Sep 07 07:59:25.726123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 261/545] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:25 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:59:25.767985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:25.775557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6216c791-4d6c-487a-8213-d9b0385406b9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1367 microversion: 2.1 time: 0.163970 Sep 07 07:59:25.776150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 285/546] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:25 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:26.738194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:26.740351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:26.746882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:26.747360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:26.747790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:26.748503 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:26.749494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:26.749912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:26.778861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-89089ca6-ee7f-46a1-8908-7bf72336c935 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044822 Sep 07 07:59:26.779400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 262/547] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:26 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:59:26.798066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:26.798702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:26.805077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:26.805662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:26.806097 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:26.806790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:26.807273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:26.807698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:26.938607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:26.946550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cee3ff5f-0298-4a0f-9711-4b6c8d4c07a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1557 microversion: 2.1 time: 0.152428 Sep 07 07:59:26.947115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 286/548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:26 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:26.969158 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:26.969650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:26.975402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:26.975878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:26.976344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:26.977018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:26.977462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:26.977886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:27.056982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-88a9111e-f269-4b5e-bdca-b6cd51723fd1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091669 Sep 07 07:59:27.057562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 263/549] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 07:59:26 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:27.064032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-447412337"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:27.064849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:27.070965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:27.071321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:27.071758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:27.072476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:27.072938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:27.073362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:27.077127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:27.339094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.network.security_group_api [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Removing security group 6d73b26c-1131-4271-97d7-f12767c82c80 from port fa535e7d-89c4-4809-ac24-7f795dbf04e8 Sep 07 07:59:27.792649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:27.794840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:27.801760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:27.802246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:27.802681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:27.803393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:27.803848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:27.804309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:27.835509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fefc97a0-0a8b-4f09-bd88-5d69cdf6fd2c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047331 Sep 07 07:59:27.836093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 264/550] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:27 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:59:28.208830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c9c30cad-2a57-4017-9157-bdf51e3c4115 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/action" status: 202 len: 0 microversion: 2.1 time: 1.149221 Sep 07 07:59:28.209442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 287/551] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:59:27 2022] POST /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/action => generated 0 bytes in 1151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:59:28.270700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-5b84a311-b976-4456-b0be-42244695e9dd req-57a41149-780c-4ef3-a22a-1c980277a2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3423c4e5-5e93-40e4-8c2a-0fd51ded639b", "tag": "fa535e7d-89c4-4809-ac24-7f795dbf04e8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:28.282541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5b84a311-b976-4456-b0be-42244695e9dd req-57a41149-780c-4ef3-a22a-1c980277a2dc service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:28.283421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5b84a311-b976-4456-b0be-42244695e9dd req-57a41149-780c-4ef3-a22a-1c980277a2dc service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:28.284072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5b84a311-b976-4456-b0be-42244695e9dd req-57a41149-780c-4ef3-a22a-1c980277a2dc service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:28.298795 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-5b84a311-b976-4456-b0be-42244695e9dd req-57a41149-780c-4ef3-a22a-1c980277a2dc service nova] Creating event network-changed:fa535e7d-89c4-4809-ac24-7f795dbf04e8 for instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b on hv-cinder-83602 Sep 07 07:59:28.304552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-5b84a311-b976-4456-b0be-42244695e9dd req-57a41149-780c-4ef3-a22a-1c980277a2dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043829 Sep 07 07:59:28.305590 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 265/552] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:28.581567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:28.588017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:28.602097 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:28.602971 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:28.603908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:28.604945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:28.605648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:28.606309 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:28.646134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lazy-loading 'flavor' on Instance uuid 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:28.807058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61efd965-ebff-493b-a940-c4c577f6b905 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/action" status: 200 len: 32 microversion: 2.1 time: 0.229624 Sep 07 07:59:28.808104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 288/553] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:59:28 2022] POST /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 07:59:28.818437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:28.819136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:28.848066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:28.849783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:28.851813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:28.852963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:28.859853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:28.860425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:28.860951 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:28.865074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:28.890809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:28.891366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:28.891821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:28.892587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:28.893048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:28.893476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:28.943273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d63c3a11-a2a9-415f-88ef-0156ba868fc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098681 Sep 07 07:59:28.944327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 289/554] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:28 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 07:59:29.331932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:29.340567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-10d107d0-6088-46f1-b9cc-6e6953d4e1bd tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.526706 Sep 07 07:59:29.341135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 266/555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:28 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:29.955677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:29.958011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:29.964345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:29.964852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:29.965302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:29.965995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:29.966480 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:29.966921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:29.997401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d357ba97-8b10-40de-8234-0dfd7411bb83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045683 Sep 07 07:59:29.997970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 290/556] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 07:59:29 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:30.074741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:30.075354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:30.082488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.083049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.083550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.084338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.084862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.085357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.111725 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 07:59:30.193853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-16f20e69-a5d3-47e3-98ea-b06cd694e65a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 204 len: 0 microversion: 2.20 time: 0.123318 Sep 07 07:59:30.195003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 267/557] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 7 07:59:30 2022] DELETE /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 07:59:30.204015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:30.204799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:30.212969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.213786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.214819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.215645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.216234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.216765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.349822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-b2e6e724-1b13-46e1-b488-57f281e9ea0c req-b18b11bc-6dd6-48df-87a5-f6e7a3e4d715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6296be2b-713c-4cc7-9c5e-6ddd1388bdab", "tag": "687b7420-4dbb-4f01-84f0-5827ccae5ed3"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:30.359018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b2e6e724-1b13-46e1-b488-57f281e9ea0c req-b18b11bc-6dd6-48df-87a5-f6e7a3e4d715 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.359713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b2e6e724-1b13-46e1-b488-57f281e9ea0c req-b18b11bc-6dd6-48df-87a5-f6e7a3e4d715 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.360170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b2e6e724-1b13-46e1-b488-57f281e9ea0c req-b18b11bc-6dd6-48df-87a5-f6e7a3e4d715 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.367597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:30.371494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-b2e6e724-1b13-46e1-b488-57f281e9ea0c req-b18b11bc-6dd6-48df-87a5-f6e7a3e4d715 service nova] Creating event network-changed:687b7420-4dbb-4f01-84f0-5827ccae5ed3 for instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab on hv-cinder-83602 Sep 07 07:59:30.376527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:30.376713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-b2e6e724-1b13-46e1-b488-57f281e9ea0c req-b18b11bc-6dd6-48df-87a5-f6e7a3e4d715 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030734 Sep 07 07:59:30.377151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 268/558] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:59:30.382884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:30.383284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:30.384649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d6ab0e3-2eb4-4b3e-83ec-a453f920f40e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.184831 Sep 07 07:59:30.384866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:30.385376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 291/559] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:30 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:30.392071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.392585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.393020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.393714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.394165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.394585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.628192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:30.636739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ca5e7de6-fa49-48eb-9296-5cc18ef653fa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.258298 Sep 07 07:59:30.637371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 269/560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:30 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:30.649109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-0727aed8-7412-49f4-ac80-a46417682a8e req-9d875fb7-0862-4326-b8a7-3db4c9cfa0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3423c4e5-5e93-40e4-8c2a-0fd51ded639b", "tag": "fa535e7d-89c4-4809-ac24-7f795dbf04e8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:30.653702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:30.654206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:30.660674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.661453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.662114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.662887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.663432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-0727aed8-7412-49f4-ac80-a46417682a8e req-9d875fb7-0862-4326-b8a7-3db4c9cfa0f9 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.663561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.663921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-0727aed8-7412-49f4-ac80-a46417682a8e req-9d875fb7-0862-4326-b8a7-3db4c9cfa0f9 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.664033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.664384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-0727aed8-7412-49f4-ac80-a46417682a8e req-9d875fb7-0862-4326-b8a7-3db4c9cfa0f9 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.675516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-0727aed8-7412-49f4-ac80-a46417682a8e req-9d875fb7-0862-4326-b8a7-3db4c9cfa0f9 service nova] Creating event network-changed:fa535e7d-89c4-4809-ac24-7f795dbf04e8 for instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b on hv-cinder-83602 Sep 07 07:59:30.680599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-0727aed8-7412-49f4-ac80-a46417682a8e req-9d875fb7-0862-4326-b8a7-3db4c9cfa0f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034809 Sep 07 07:59:30.681192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 270/561] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:30.757536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lazy-loading 'services' on Instance uuid 3423c4e5-5e93-40e4-8c2a-0fd51ded639b {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:30.835124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4a9bb9b-25e0-4f73-81d5-57c33455f4eb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments/af8660a1-280a-4df6-8432-95f4776c5ab2" status: 202 len: 0 microversion: 2.1 time: 0.192979 Sep 07 07:59:30.835726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 292/562] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 07:59:30 2022] DELETE /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments/af8660a1-280a-4df6-8432-95f4776c5ab2 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:59:30.844870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:30.847251 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:30.854426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.854929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.855372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.856113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:30.856581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:30.857013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:30.889357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-43202a4a-a0ce-4b43-aee1-9aee5896c860 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048906 Sep 07 07:59:30.889940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 271/563] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:59:30 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:31.412277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:31.413133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:31.419560 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:31.420158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:31.421534 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:31.422360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:31.422876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:31.423368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:31.565342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:31.573707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:31.575205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:31.576379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6be5edd-84a6-4cd9-89a5-af01ce24bf0c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.169036 Sep 07 07:59:31.576978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 293/564] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:31 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:59:31.661634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:31.662346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:31.668730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:31.669258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:31.669724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:31.670973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:31.671708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:31.672292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:31.689062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:31.828419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:31.836796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-96230df9-a7ac-493a-8413-e21be792f482 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.179093 Sep 07 07:59:31.837354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 272/565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:31 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:31.901869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:31.904179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:31.911049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:31.911529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:31.911961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:31.912680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:31.913127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:31.913548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:31.945522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6068331c-1aff-4530-b664-fdb5e96c7b96 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048221 Sep 07 07:59:31.946124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 294/566] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:59:31 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:32.602927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:32.603509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:32.610104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:32.610588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:32.611022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:32.611718 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:32.612207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:32.612636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:32.863637 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:32.864896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:32.873029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:32.873852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:32.874082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:32.874945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:32.875402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:32.875823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:33.015155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:33.019369 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:33.024048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b23b258-e484-4bc1-9482-986314f2aa51 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.166145 Sep 07 07:59:33.025147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 295/567] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:32 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:33.030812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:33.033251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:33.040573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:33.041346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:33.041486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:33.041822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:33.042766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:33.043833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:33.046168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:33.046652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:33.047235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7784b831-b675-4eb7-8b90-81bb9d508243 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1724 microversion: 2.20 time: 0.447730 Sep 07 07:59:33.047831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 273/568] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:32 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:33.078984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68d2ccd9-b3b6-490c-a7f8-fa45229091ee tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052553 Sep 07 07:59:33.079596 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 296/569] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:59:33 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:34.002145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-672eb804-b624-4364-9d6e-fe420c38e864 req-cf69a43e-b433-443e-b972-104e53d67de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bf06d0-30dc-4a08-94a4-bac302f07efb", "name": "network-vif-deleted", "tag": "21b12ceb-ddd4-48f9-8f8c-e7c2fd169986"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:34.011886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-672eb804-b624-4364-9d6e-fe420c38e864 req-cf69a43e-b433-443e-b972-104e53d67de7 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.012388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-672eb804-b624-4364-9d6e-fe420c38e864 req-cf69a43e-b433-443e-b972-104e53d67de7 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.012887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-672eb804-b624-4364-9d6e-fe420c38e864 req-cf69a43e-b433-443e-b972-104e53d67de7 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.025459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-672eb804-b624-4364-9d6e-fe420c38e864 req-cf69a43e-b433-443e-b972-104e53d67de7 service nova] Creating event network-vif-deleted:21b12ceb-ddd4-48f9-8f8c-e7c2fd169986 for instance 86bf06d0-30dc-4a08-94a4-bac302f07efb on hv-cinder-83602 Sep 07 07:59:34.031132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-672eb804-b624-4364-9d6e-fe420c38e864 req-cf69a43e-b433-443e-b972-104e53d67de7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032798 Sep 07 07:59:34.034912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 274/570] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:34.049161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:34.049891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:34.059158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.059640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.060101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.060876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.061367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.061921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.075274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:34.077124 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:34.084447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.085360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.086454 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.087393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.088121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.088762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.174550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:34.183515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:34.185008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:34.186532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1508648f-115b-49fc-8b7c-fc69989f82dd tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 200 len: 1367 microversion: 2.20 time: 0.115778 Sep 07 07:59:34.187511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 275/571] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:34 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 1367 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:34.192737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:34.199605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:34.212178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.213112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.215821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.216751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.218466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.219150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.271704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aee9f751-a9c3-47fd-8798-b17622eb4ebc tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082792 Sep 07 07:59:34.272670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 276/572] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 07:59:34 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 07:59:34.273408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:34.284930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:34.285109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dcac7466-7643-43e3-835a-f22dd26a3e61 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.239842 Sep 07 07:59:34.285428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:34.286364 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 297/573] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:34 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:34.303913 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.304616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.305056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.305760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:34.306214 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:34.306780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:34.386598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] HTTP exception thrown: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b is not attached to volume af8660a1-280a-4df6-8432-95f4776c5ab2 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Request method failure captured: Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments/af8660a1-280a-4df6-8432-95f4776c5ab2 HTTP/1.1 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE6qXfUurCUYlKUUC8azCqPRacj1_DOsNbhMYd13Bbwa2Pf89Exl-9w-h75noPahIubIps2lBjvqozt42Nny8A9PdX27u48CXCNIBdXsjwl5lelzqQ7YmnWa2p3ieSHa7_2q7dD2APc_F0wUZjIQIztJ9L2AVThXNOm13eXNiELMQ24 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 126a90736fb3438ab05ffeae4bafa7a1 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-TestMinimumBasicScenario-368525914 Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 07:59:34.389256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/126a90736fb3438ab05ffeae4bafa7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_126a90736fb3438ab05ffeae4bafa7a1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/126a90736fb3438ab05ffeae4bafa7a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/126a90736fb3438ab05ffeae4bafa7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-TestMinimumBasicScenario-368525914 Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 126a90736fb3438ab05ffeae4bafa7a1 Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-TestMinimumBasicScenario-368525914 Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-TestMinimumBasicScenario-368525914-project Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: f018f290f36f4121becdfcc2bc10827c Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-TestMinimumBasicScenario-368525914-project Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 07:59:34.391200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b is not attached to volume af8660a1-280a-4df6-8432-95f4776c5ab2 Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'server_id': '3423c4e5-5e93-40e4-8c2a-0fd51ded639b', 'id': 'af8660a1-280a-4df6-8432-95f4776c5ab2'} Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id af8660a1-280a-4df6-8432-95f4776c5ab2. Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:59:34.392029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b is not attached to volume af8660a1-280a-4df6-8432-95f4776c5ab2 Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b is not attached to volume af8660a1-280a-4df6-8432-95f4776c5ab2 Sep 07 07:59:34.393478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:34.394883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Returning 404 to user: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b is not attached to volume af8660a1-280a-4df6-8432-95f4776c5ab2 {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:59:34.395499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-469fba05-8c9e-4183-bff7-d8a98202c6fb tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments/af8660a1-280a-4df6-8432-95f4776c5ab2" status: 404 len: 154 microversion: 2.1 time: 0.115930 Sep 07 07:59:34.396164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 277/574] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 07:59:34 2022] DELETE /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b/os-volume_attachments/af8660a1-280a-4df6-8432-95f4776c5ab2 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 07:59:35.212392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:35.212920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:35.220200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.220685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.221116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.221800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.222255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.222676 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.236718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] HTTP exception thrown: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Request method failure captured: Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb HTTP/1.1 Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5v3gFQmvtD0L9VIdTBc6nD6Hm_p9a_K5IbHEAmhnFPQww1VR2SW1VL2aRgfw7_DyTDOaePKyldwyqVRhHlIJ7bd834rh5I7Iy0W3LQb6z-UdxIVndAP1dFy6OGVUtufaJIvjoHmAgctG2lb8bCnwHq1aQMGnZp-xJEqPetsHEzhBQ Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 07:59:35.238342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18463a34e4aa4b89a2a9ccad75a0d81e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 457d69a7306d46cd8445f887eb95c517 Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 07:59:35.239906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '86bf06d0-30dc-4a08-94a4-bac302f07efb'} Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:59:35.240820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 07:59:35.242487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 07:59:35.243875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Returning 404 to user: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:59:35.243875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3209a979-f3a0-43a1-b7c6-6078f3424cec tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 404 len: 111 microversion: 2.20 time: 0.031391 Sep 07 07:59:35.243875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 298/575] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:35 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 07:59:35.248638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ff7d2736-ce62-4fdb-827a-b7764587faab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '.version_select at 0x7f831eb1e040>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:35.268226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ff7d2736-ce62-4fdb-827a-b7764587faab tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795564661" status: 204 len: 0 microversion: 2.20 time: 0.023357 Sep 07 07:59:35.268803 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 278/576] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Sep 7 07:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795564661 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 07:59:35.312962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:35.313683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:35.320000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.320523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.320993 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.321692 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.322150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.322572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.461773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:35.470336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c813c24a-c6f9-45e6-a955-e8575cb8cf1c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.164230 Sep 07 07:59:35.470835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 299/577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:35 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:35.550605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:35.551110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:35.557185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.557669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.558109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.558797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.559251 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.559677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.584795 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 07:59:35.662645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-037470a2-fef0-477c-8ab7-fbdd8580c89a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 204 len: 0 microversion: 2.1 time: 0.115609 Sep 07 07:59:35.663236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 279/578] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 07:59:35 2022] DELETE /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 07:59:35.671588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:35.672544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:35.679580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.680074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.680560 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.681266 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:35.681719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:35.682148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:35.818274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:35.826084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2bd1feb-6169-495e-bd2f-3dcb452a1d85 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1554 microversion: 2.1 time: 0.158610 Sep 07 07:59:35.826843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 300/579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:35 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:35.927845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3465be4f-5664-4f5c-a5e5-842f523b9e92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'create', calling method: .version_select at 0x7f831eb1eaf0>, body: {"keypair": {"name": "tempest-keypair-1668409808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXA0nhF6EntJD03biCtQxcvEzBzxJXjKGPfAXUm6BltsM+KHVz2Ax51HLANyMhc4mPhkPbNkkv2Fo4IXlCuMFXC5lLhc0TddPBHUiZiDOEQrPWe/USb0yzP4645oDfowg=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:35.944439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-3465be4f-5664-4f5c-a5e5-842f523b9e92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:59:35.948373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-3465be4f-5664-4f5c-a5e5-842f523b9e92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for user 457d69a7306d46cd8445f887eb95c517 and project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:59:35.970391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3465be4f-5664-4f5c-a5e5-842f523b9e92 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047038 Sep 07 07:59:35.971032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 280/580] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Sep 7 07:59:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 07:59:36.493945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:36.494587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:36.501092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:36.501580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:36.502018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:36.502706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:36.503164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:36.503588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:36.726881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:36.735801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec0f0d99-a702-45b6-a46e-0d5513743c7f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.245775 Sep 07 07:59:36.736629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 301/581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:36 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:36.853912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:36.854667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:36.863228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:36.868156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:36.869598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:36.870043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:36.870750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:36.871209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:36.871635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:37.005572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:37.013286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9aba776d-a5f9-4f6a-a3a1-ca3ff32a1f91 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1554 microversion: 2.1 time: 0.166993 Sep 07 07:59:37.013873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 281/582] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:36 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:37.335208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1805089281", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1b8879d-7ef7-414a-a6c3-f77fea09d2f8"}], "security_groups": [{"name": "tempest-securitygroup--1486638565"}], "key_name": "tempest-keypair-1668409808", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:37.437931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] validate_networks() for [('c1b8879d-7ef7-414a-a6c3-f77fea09d2f8', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 07:59:37.759031 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:37.759722 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:37.765778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:37.766273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:37.766706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:37.767397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:37.767850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:37.768299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:37.812506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 07:59:37.813496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 07:59:37.813978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 07:59:37.814643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 07:59:37.815058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 07:59:37.824033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:37.824540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:37.825146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:37.826085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:37.826809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:37.827547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:37.834672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:37.848073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 07:59:37.852454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Getting quotas for user 457d69a7306d46cd8445f887eb95c517 and project 18463a34e4aa4b89a2a9ccad75a0d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 07:59:37.864049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 07:59:37.866382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 07:59:37.916889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7ca21882-12fc-4a7b-8475-4c9435901d93 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.585490 Sep 07 07:59:37.917541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 302/583] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Sep 7 07:59:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 07:59:37.928616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5fbd996a-10ee-430c-87a5-79e19abf9679 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:37.929220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5fbd996a-10ee-430c-87a5-79e19abf9679 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:37.995218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5fbd996a-10ee-430c-87a5-79e19abf9679 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:38.004944 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5fbd996a-10ee-430c-87a5-79e19abf9679 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:38.006681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5fbd996a-10ee-430c-87a5-79e19abf9679 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:38.008404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5fbd996a-10ee-430c-87a5-79e19abf9679 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1282 microversion: 2.20 time: 0.083561 Sep 07 07:59:38.009737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 303/584] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:37 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:59:38.018096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:38.026361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d3f32d99-21fb-4774-8621-87e9c1f40644 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.271226 Sep 07 07:59:38.026930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 282/585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:37 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:38.037259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:38.037920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:38.047007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:38.047762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:38.048270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:38.049084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:38.050373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:38.050373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:38.192847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:38.202284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-302731dd-da3f-4da6-85b2-4430e2dec63c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1554 microversion: 2.1 time: 0.168448 Sep 07 07:59:38.203063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 304/586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:38 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:38.645466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-cc9b8231-a557-49c1-ae27-261797cd1e3e req-c1da89ad-0c4f-4553-970c-b3df53a00e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3423c4e5-5e93-40e4-8c2a-0fd51ded639b", "name": "network-vif-deleted", "tag": "fa535e7d-89c4-4809-ac24-7f795dbf04e8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:38.655812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-cc9b8231-a557-49c1-ae27-261797cd1e3e req-c1da89ad-0c4f-4553-970c-b3df53a00e16 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:38.656364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-cc9b8231-a557-49c1-ae27-261797cd1e3e req-c1da89ad-0c4f-4553-970c-b3df53a00e16 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:38.656765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-cc9b8231-a557-49c1-ae27-261797cd1e3e req-c1da89ad-0c4f-4553-970c-b3df53a00e16 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:38.668481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-cc9b8231-a557-49c1-ae27-261797cd1e3e req-c1da89ad-0c4f-4553-970c-b3df53a00e16 service nova] Creating event network-vif-deleted:fa535e7d-89c4-4809-ac24-7f795dbf04e8 for instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b on hv-cinder-83602 Sep 07 07:59:38.673890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-cc9b8231-a557-49c1-ae27-261797cd1e3e req-c1da89ad-0c4f-4553-970c-b3df53a00e16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032023 Sep 07 07:59:38.674476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 283/587] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:39.034055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:39.035510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:39.043267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:39.043759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:39.044247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:39.045632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:39.046287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:39.046967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:39.053551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:39.054965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:39.061603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:39.062090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:39.062533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:39.063497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:39.063952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:39.064649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:39.114542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:39.123404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:39.125567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:39.126696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-092fad34-34df-4643-9fc8-21ccf15d4d5d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1334 microversion: 2.20 time: 0.097089 Sep 07 07:59:39.127249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 305/588] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:39 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:39.203377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:39.211476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ac8dff3e-7520-4730-9514-95eda901b90c tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.162741 Sep 07 07:59:39.212028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 284/589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:39 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:39.225140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:39.225744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:39.231603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:39.232094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:39.232533 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:39.233843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:39.234288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:39.234708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:39.264381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:39.264848 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:39.265275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:39.265712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lazy-loading 'fault' on Instance uuid 3423c4e5-5e93-40e4-8c2a-0fd51ded639b {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:39.306131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f018f290f36f4121becdfcc2bc10827c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126a90736fb3438ab05ffeae4bafa7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:39.315080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8bcc6c2-fedd-4d83-9da7-7334349b672a tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 200 len: 1349 microversion: 2.1 time: 0.093710 Sep 07 07:59:39.315657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 306/590] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:39 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:40.151755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:40.152402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:40.159416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:40.159905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:40.160546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:40.161926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:40.162388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:40.162819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:40.235885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:40.238022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:40.239955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:40.247775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:40.248828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:40.249262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:40.249994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:40.250442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:40.251059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:40.251417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:40.253207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:40.254431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4be1f85e-8612-4bea-8f38-ae7f00e2a52b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1340 microversion: 2.20 time: 0.107076 Sep 07 07:59:40.265758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 285/591] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:40 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1340 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:59:40.337779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:40.338700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] [instance: 3423c4e5-5e93-40e4-8c2a-0fd51ded639b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:40.345329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:40.346017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:40.346549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:40.348182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:40.348857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:40.349623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:40.365835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] HTTP exception thrown: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b could not be found. Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Request method failure captured: Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b HTTP/1.1 Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE6qXfUurCUYlKUUC8azCqPRacj1_DOsNbhMYd13Bbwa2Pf89Exl-9w-h75noPahIubIps2lBjvqozt42Nny8A9PdX27u48CXCNIBdXsjwl5lelzqQ7YmnWa2p3ieSHa7_2q7dD2APc_F0wUZjIQIztJ9L2AVThXNOm13eXNiELMQ24 Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 126a90736fb3438ab05ffeae4bafa7a1 Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-TestMinimumBasicScenario-368525914 Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 07:59:40.368384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/126a90736fb3438ab05ffeae4bafa7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_126a90736fb3438ab05ffeae4bafa7a1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/126a90736fb3438ab05ffeae4bafa7a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/126a90736fb3438ab05ffeae4bafa7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-TestMinimumBasicScenario-368525914 Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 126a90736fb3438ab05ffeae4bafa7a1 Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-TestMinimumBasicScenario-368525914 Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-TestMinimumBasicScenario-368525914-project Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: f018f290f36f4121becdfcc2bc10827c Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-TestMinimumBasicScenario-368525914-project Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b could not be found. Sep 07 07:59:40.369901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '3423c4e5-5e93-40e4-8c2a-0fd51ded639b'} Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b could not be found. Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:59:40.370824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b could not be found. Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b could not be found. Sep 07 07:59:40.372281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:40.375015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Returning 404 to user: Instance 3423c4e5-5e93-40e4-8c2a-0fd51ded639b could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:59:40.376120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b4d395b3-146f-430b-99fc-c4a45d19c918 tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b" status: 404 len: 111 microversion: 2.1 time: 0.042501 Sep 07 07:59:40.377177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 286/592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:40 2022] GET /compute/v2.1/servers/3423c4e5-5e93-40e4-8c2a-0fd51ded639b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 07:59:40.387722 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4ac2e3c4-9386-4817-abd3-8268676db33c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] Calling method '.version_select at 0x7f831ea77550>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:40.414572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4ac2e3c4-9386-4817-abd3-8268676db33c tempest-TestMinimumBasicScenario-368525914 tempest-TestMinimumBasicScenario-368525914-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1619576350" status: 202 len: 0 microversion: 2.1 time: 0.032784 Sep 07 07:59:40.414934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 287/593] 10.222.0.26 () {58 vars in 1272 bytes} [Wed Sep 7 07:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1619576350 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:59:40.419594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:40.430043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2da62176-04c0-4636-bdb9-cec437735dee tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.197819 Sep 07 07:59:40.430945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 307/594] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:40 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:41.187264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-ddbdee00-43d3-431f-82f2-76995e99af70 req-9fd9afbe-3084-49f8-9d19-da877e61c1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b921f49-ab37-4207-8301-4d822f5cebaf", "tag": "e8074f9b-36f4-44cb-a791-0408a89aa4d8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:41.200461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ddbdee00-43d3-431f-82f2-76995e99af70 req-9fd9afbe-3084-49f8-9d19-da877e61c1c2 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:41.201002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ddbdee00-43d3-431f-82f2-76995e99af70 req-9fd9afbe-3084-49f8-9d19-da877e61c1c2 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:41.201766 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ddbdee00-43d3-431f-82f2-76995e99af70 req-9fd9afbe-3084-49f8-9d19-da877e61c1c2 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:41.213952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-ddbdee00-43d3-431f-82f2-76995e99af70 req-9fd9afbe-3084-49f8-9d19-da877e61c1c2 service nova] Creating event network-changed:e8074f9b-36f4-44cb-a791-0408a89aa4d8 for instance 5b921f49-ab37-4207-8301-4d822f5cebaf on hv-cinder-83602 Sep 07 07:59:41.220302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-ddbdee00-43d3-431f-82f2-76995e99af70 req-9fd9afbe-3084-49f8-9d19-da877e61c1c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037807 Sep 07 07:59:41.221399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 288/595] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:41.282185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:41.283429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:41.290439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:41.290925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:41.291453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:41.292211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:41.292856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:41.293286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:41.455511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:41.456365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:41.462736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:41.463421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:41.463932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:41.464738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:41.465295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:41.465800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:41.714208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:41.724898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-65633580-7809-4295-a5a8-d32550a933af tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.274199 Sep 07 07:59:41.725592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 289/596] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:41 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:41.801835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:41.810185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:41.811922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:41.813232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f93e7ac-0cb8-4e61-ba80-22f8c664850a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1408 microversion: 2.20 time: 0.536284 Sep 07 07:59:41.813800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 308/597] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:41 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:42.750214 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:42.750831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:42.757188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:42.757673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:42.758120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:42.758810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:42.759263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:42.759717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:42.839558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:42.848439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:42.860891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:42.862268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:42.862938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:42.863864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:42.864566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:42.865270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:42.916122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:42.926082 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3bcaf1f9-ac44-4a36-8bdf-005f7e21e660 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.180037 Sep 07 07:59:42.926685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 290/598] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:42 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:43.102311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:43.112571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:43.114045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:43.115474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb9c220a-3dc5-4f32-bfa8-2f73d4ed3a45 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1408 microversion: 2.20 time: 0.280065 Sep 07 07:59:43.115974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 309/599] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:42 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:43.953066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:43.953897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:43.961162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:43.961966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:43.962269 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:43.962964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:43.963416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:43.963833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:44.020904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:44.022019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:44.029876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:44.030435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:44.030878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:44.032112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:44.032589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:44.033748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:44.146801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lazy-loading 'services' on Instance uuid e625ca1a-4906-44bc-afe5-092b2f95c4d9 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 07:59:44.154802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:44.163304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d5558978-073f-4407-85cd-1ce79235fae3 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.216432 Sep 07 07:59:44.164036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 291/600] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:43 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:44.169064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:44.169669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:44.175617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:44.176121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:44.176552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:44.177410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:44.178587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:44.179286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:44.238917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57b42147-f8ea-4c8d-b67b-99135d5c8a2a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-volume_attachments/c9bbbc0e-167a-46ee-ab37-4ae6fdbc5032" status: 202 len: 0 microversion: 2.1 time: 0.222608 Sep 07 07:59:44.240072 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 310/601] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 07:59:44 2022] DELETE /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-volume_attachments/c9bbbc0e-167a-46ee-ab37-4ae6fdbc5032 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 07:59:44.375166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:44.387859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:44.389899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:44.397399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cfc235ab-9730-439a-b6f2-502c6bcad683 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1408 microversion: 2.20 time: 0.231936 Sep 07 07:59:44.397934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 292/602] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:44 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:45.187542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:45.188278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:45.195167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:45.195681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:45.196261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:45.196977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:45.197413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:45.197833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:45.394764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:45.418359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4aeea7e9-ab3c-424f-a682-f6740d4734d1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.235487 Sep 07 07:59:45.419355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 311/603] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:45 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:45.431902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:45.440770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:45.447578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:45.451993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:45.452646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:45.453540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:45.454163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:45.454756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:45.458350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:45.473505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7dd53da-8524-4e43-af40-10e2598c0484 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:45.482485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7dd53da-8524-4e43-af40-10e2598c0484 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:45.484071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7dd53da-8524-4e43-af40-10e2598c0484 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:45.485244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7dd53da-8524-4e43-af40-10e2598c0484 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:45.511620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7dd53da-8524-4e43-af40-10e2598c0484 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Going to try to stop instance {{(pid=120494) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 07:59:45.565544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7dd53da-8524-4e43-af40-10e2598c0484 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action" status: 202 len: 0 microversion: 2.1 time: 0.096452 Sep 07 07:59:45.569183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 312/604] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:59:45 2022] POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 07:59:45.574839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:45.575654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:45.586758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:45.587495 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:45.588139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:45.589129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:45.589726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:45.590432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:45.653394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:45.671488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:45.674227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:45.675742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-377baff1-5a34-4f7b-86ba-39a084a88c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1408 microversion: 2.20 time: 0.250545 Sep 07 07:59:45.676655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 293/605] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:45 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:45.733698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:45.741583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40111524-6ab8-4f0f-b306-acff47a41025 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.170786 Sep 07 07:59:45.742161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 313/606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:45 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:46.443395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:46.444782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:46.450498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:46.454745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:46.455484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:46.456144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:46.457026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:46.457648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:46.458242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:46.506569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-0b34eecf-037b-4f1c-878b-6da529db1bd1 req-bc0a29fe-dc9b-4cc1-91f0-92223fcacd7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b921f49-ab37-4207-8301-4d822f5cebaf", "name": "network-vif-plugged", "status": "completed", "tag": "e8074f9b-36f4-44cb-a791-0408a89aa4d8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:46.519271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0b34eecf-037b-4f1c-878b-6da529db1bd1 req-bc0a29fe-dc9b-4cc1-91f0-92223fcacd7a service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:46.520591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0b34eecf-037b-4f1c-878b-6da529db1bd1 req-bc0a29fe-dc9b-4cc1-91f0-92223fcacd7a service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:46.521186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-0b34eecf-037b-4f1c-878b-6da529db1bd1 req-bc0a29fe-dc9b-4cc1-91f0-92223fcacd7a service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:46.534454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-0b34eecf-037b-4f1c-878b-6da529db1bd1 req-bc0a29fe-dc9b-4cc1-91f0-92223fcacd7a service nova] Creating event network-vif-plugged:e8074f9b-36f4-44cb-a791-0408a89aa4d8 for instance 5b921f49-ab37-4207-8301-4d822f5cebaf on hv-cinder-83602 Sep 07 07:59:46.540444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-0b34eecf-037b-4f1c-878b-6da529db1bd1 req-bc0a29fe-dc9b-4cc1-91f0-92223fcacd7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038089 Sep 07 07:59:46.541255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 314/607] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:59:46.703267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:46.703970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:46.710570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:46.711066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:46.711519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:46.712237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:46.712824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:46.714075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:46.821138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:46.831048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9a311c54-aa91-489c-a59e-040fa6af901b tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.391687 Sep 07 07:59:46.844793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 294/608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:46 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:46.854368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:46.855906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:46.862748 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:46.863577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:46.864296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:46.865411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:46.866104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:46.866980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:46.898217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:46.909734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:46.911684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:46.913271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b21f09e-ac23-429a-8a53-8f23eb7e695a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1408 microversion: 2.20 time: 0.214402 Sep 07 07:59:46.915943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 315/609] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:46 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:59:47.103484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:47.111358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1715dd7d-7ba5-4a07-886a-0e1006690f94 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.265044 Sep 07 07:59:47.111932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 295/610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:46 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:47.860453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:47.861144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:47.863629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:47.870345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:47.870841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:47.871276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:47.871979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:47.872943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:47.873426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:47.940218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:47.943731 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:47.960790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:47.961436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:47.966128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:47.969285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:47.970021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:47.970696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:48.002349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:48.047829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:48.058199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8ec724f-1ed6-4875-a688-09d40d28d74a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.203008 Sep 07 07:59:48.059340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 316/611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:47 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:48.135987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:48.136806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:48.144629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:48.145398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:48.146997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:48.149988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:48.150970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:48.151441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:48.272652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:48.289216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:48.290921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:48.293104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ad709068-9826-4d74-a22f-bbcd323dade1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1408 microversion: 2.20 time: 0.357995 Sep 07 07:59:48.294291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 296/612] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:47 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 07:59:48.334185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:48.342450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8af5dbea-0fca-483e-be50-e513281aef9b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.211348 Sep 07 07:59:48.343032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 317/613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:48 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:49.083379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:49.083926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:49.089960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.090440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.090868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.091578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.092033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.092476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.241631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:49.249906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-185ec91f-5a35-4e72-b3aa-9674615a2c1a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.171137 Sep 07 07:59:49.250475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 297/614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:49 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:49.320952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:49.321772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:49.328561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.329048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.329488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.330179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.330634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.331053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.365988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:49.366623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:49.372835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.373699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.374143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.374941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.375568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.376001 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.470883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:49.482682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:49.484797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:49.487287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cfd8d4c-7fed-4331-b48e-a0dfdddcdcd7 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1600 microversion: 2.20 time: 0.169780 Sep 07 07:59:49.488503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 318/615] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 07:59:49 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 07:59:49.515834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:49.516349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:49.522875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.523580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.524011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.524728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:49.525175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:49.525783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:49.529974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:49.547978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:49.559402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d09ad780-f547-46b6-a14c-6c366cc62552 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.196737 Sep 07 07:59:49.560310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 298/616] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:49 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:49.613114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76e702e4-4ada-4a87-8b10-2471d8f24585 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102274 Sep 07 07:59:49.613745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 319/617] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Sep 7 07:59:49 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 07:59:50.273531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:50.274252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:50.280744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:50.281236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:50.281681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:50.282377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:50.282831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:50.283258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:50.501849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:50.509917 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fec82abc-febf-4265-ab7d-52368f1c6df1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.240250 Sep 07 07:59:50.510474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 299/618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:50 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:50.583586 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:50.584212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:50.590629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:50.591127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:50.591614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:50.592471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:50.592972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:50.593406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:50.731877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:50.740531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88ee5c49-944b-47db-b803-9163242cb8a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.161283 Sep 07 07:59:50.741105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 320/619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:50 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:50.965794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-d2609b51-44d1-41a0-a59a-0b6399f4c91a req-2fc0749f-9681-4ca4-9c11-c756816ec03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b921f49-ab37-4207-8301-4d822f5cebaf", "tag": "e8074f9b-36f4-44cb-a791-0408a89aa4d8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:50.975778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d2609b51-44d1-41a0-a59a-0b6399f4c91a req-2fc0749f-9681-4ca4-9c11-c756816ec03e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:50.976320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d2609b51-44d1-41a0-a59a-0b6399f4c91a req-2fc0749f-9681-4ca4-9c11-c756816ec03e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:50.976786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d2609b51-44d1-41a0-a59a-0b6399f4c91a req-2fc0749f-9681-4ca4-9c11-c756816ec03e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:50.988714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-d2609b51-44d1-41a0-a59a-0b6399f4c91a req-2fc0749f-9681-4ca4-9c11-c756816ec03e service nova] Creating event network-changed:e8074f9b-36f4-44cb-a791-0408a89aa4d8 for instance 5b921f49-ab37-4207-8301-4d822f5cebaf on hv-cinder-83602 Sep 07 07:59:50.993977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-d2609b51-44d1-41a0-a59a-0b6399f4c91a req-2fc0749f-9681-4ca4-9c11-c756816ec03e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031837 Sep 07 07:59:50.995132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 300/620] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:51.533850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:51.534456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:51.540413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:51.540893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:51.541324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:51.542002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:51.542453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:51.542872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:51.673012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:51.681203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-80feace9-6e3e-4303-b18b-171dc8d1c403 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1735 microversion: 2.1 time: 0.151222 Sep 07 07:59:51.682454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 321/621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:51 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:51.765027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:51.765761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:51.771828 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:51.772344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:51.772784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:51.773476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:51.773933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:51.774359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:52.038237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:52.046782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8b7e6ed9-d628-4d24-b38d-394549028e33 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.287323 Sep 07 07:59:52.047765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 301/622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:51 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:52.706398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:52.707002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:52.713514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:52.714000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:52.714542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:52.715233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:52.715687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:52.716136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:52.848280 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:52.856412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b4b79a4f-95d6-420b-a921-4422630e8428 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1715 microversion: 2.1 time: 0.153876 Sep 07 07:59:52.856962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 322/623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:52 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:52.965929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:52.966990 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:52.973403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:52.973880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:52.974309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:52.974981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:52.975428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:52.975848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:53.059816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] HTTP exception thrown: Cannot 'detach_volume' instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 while it is in vm_state rescued Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Request method failure captured: Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments/3fee1d37-6c38-4421-a1b4-781f54ac7081 HTTP/1.1 Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5sTGRLiOMZ9BztMknjwb1bTtmawAr05yKxmMY6XSOU-KGdsmV2iVQKqW9_UUIk6hFZCmT4z6YqxgGZt599G6X9iaYWqSu0TMD3sA6Re6ROAEQYf9ZHymvf2WTN82nDB54vuXv7oje7dmNjBVjSQD6pA5gfJ7cozNzZVvgrcxmLLHk Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 07:59:53.061638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4d3d7139782f4b63ac6dc8d4618abe64", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: b52ececfc19b41b5b8387dc6908d4a4a Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 07:59:53.063173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Cannot 'detach_volume' instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 while it is in vm_state rescued Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'server_id': '9a4aca7e-3298-4cfa-9690-01676e2e1ab1', 'id': '3fee1d37-6c38-4421-a1b4-781f54ac7081'} Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 07:59:53.063947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 while it is in vm_state rescued Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 while it is in vm_state rescued Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 07:59:53.065475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Returning 409 to user: Cannot 'detach_volume' instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 while it is in vm_state rescued {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 07:59:53.066426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cff441b5-c325-4c67-84e8-39fb2e586965 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments/3fee1d37-6c38-4421-a1b4-781f54ac7081" status: 409 len: 152 microversion: 2.1 time: 0.101051 Sep 07 07:59:53.066426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 302/624] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 07:59:52 2022] DELETE /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments/3fee1d37-6c38-4421-a1b4-781f54ac7081 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 07:59:53.070298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:53.070900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:53.071795 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:53.072360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:53.072845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 07:59:53.079052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:53.079240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:53.079574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:53.079736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:53.080015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:53.080207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:53.080737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:53.080906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:53.081191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:53.081358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:53.081616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:53.081775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:53.150255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3d980bfc-b6d6-4919-982a-9c208df25c96 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "POST /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.081958 Sep 07 07:59:53.151214 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 303/625] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:59:53 2022] POST /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 07:59:53.159756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:53.160483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:53.166800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:53.167345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:53.167820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:53.168541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:53.169122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:53.170135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:53.217753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:53.225860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-211ab750-f39c-4dcd-ada0-9e832ddbcd20 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.159386 Sep 07 07:59:53.228122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 323/626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:53 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:53.320260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:53.329037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-321cdf52-b11d-44fa-bd4b-a98d77171a33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1723 microversion: 2.1 time: 0.173239 Sep 07 07:59:53.329634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 304/627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:53 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:54.250965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:54.251608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:54.258129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:54.258614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:54.259051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:54.259743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:54.260220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:54.260645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:54.352452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:54.353148 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:54.359032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:54.359514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:54.359941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:54.360781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:54.361228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:54.361655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:54.395283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:54.402961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6bc57855-4503-4672-99f0-a074a218868a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.155997 Sep 07 07:59:54.403526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 324/628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:54 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:54.491230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:54.499882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fd77ee33-889b-4dce-9c16-1c6c755d3d8a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1723 microversion: 2.1 time: 0.151464 Sep 07 07:59:54.500478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 305/629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:54 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:55.428361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:55.428977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:55.435487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:55.436071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:55.436535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:55.437232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:55.437694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:55.438122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:55.522790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:55.523539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:55.530600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:55.531083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:55.531515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:55.532232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:55.532681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:55.533102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:55.569839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:55.578318 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdca5603-84af-4646-80ad-bcd1d6ea27ff tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1679 microversion: 2.1 time: 0.153857 Sep 07 07:59:55.578872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 325/630] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:55 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:55.666240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:55.674366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-712f057e-3d16-4c6a-ab24-45ff30cb7c1d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1723 microversion: 2.1 time: 0.155474 Sep 07 07:59:55.674927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 306/631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:55 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:56.601222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:56.601834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:56.608981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.609460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.609889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.610569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.611020 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.611439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.697769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:56.698494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:56.705081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.705658 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.706201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.706961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.707488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.707980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.739486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:56.747240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b51aba63-1824-4e6a-a7f1-eed0e0dfa4a2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1656 microversion: 2.1 time: 0.149890 Sep 07 07:59:56.748367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 326/632] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:56 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 07:59:56.770017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98f304bc-8f79-41e9-a239-0889f5e8fddc tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:56.775890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98f304bc-8f79-41e9-a239-0889f5e8fddc tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.776410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98f304bc-8f79-41e9-a239-0889f5e8fddc tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.776845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98f304bc-8f79-41e9-a239-0889f5e8fddc tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.799959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98f304bc-8f79-41e9-a239-0889f5e8fddc tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Going to try to start instance {{(pid=120494) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 07:59:56.842907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98f304bc-8f79-41e9-a239-0889f5e8fddc tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action" status: 202 len: 0 microversion: 2.1 time: 0.076295 Sep 07 07:59:56.843100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:56.843816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 327/633] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 07:59:56 2022] POST /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 07:59:56.852760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-901aae03-d49c-4b1e-a9a1-0afda6a21d0e tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1729 microversion: 2.1 time: 0.158766 Sep 07 07:59:56.864146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 307/634] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:56 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:56.864342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:56.864342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:56.864342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.864645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.864962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.865979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.866098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.866844 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.877983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:56.878508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:56.884547 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.885032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.885474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.886170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:56.886854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:56.887285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:56.965912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-057bbb6a-7287-49a5-b4a8-85de8525d32d tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091853 Sep 07 07:59:56.967591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 308/635] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 07:59:56 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 07:59:57.104786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:57.114176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2933e213-79f9-477e-bfac-a8552d447a05 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1665 microversion: 2.1 time: 0.266131 Sep 07 07:59:57.119825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 328/636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:56 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1665 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 07:59:58.136589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-4b3060b3-024d-4088-9725-f93f66fa4ec9 req-3404864c-a173-47e6-81d7-7b7dc0038951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4aca7e-3298-4cfa-9690-01676e2e1ab1", "tag": "3a3f0e9f-714c-4d7f-8738-852d6e45f0b5"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 07:59:58.137376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 07:59:58.137988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 07:59:58.145722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:58.146474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:58.147078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:58.147959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:58.148606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:58.149268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:58.151140 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4b3060b3-024d-4088-9725-f93f66fa4ec9 req-3404864c-a173-47e6-81d7-7b7dc0038951 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 07:59:58.152698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4b3060b3-024d-4088-9725-f93f66fa4ec9 req-3404864c-a173-47e6-81d7-7b7dc0038951 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 07:59:58.153151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4b3060b3-024d-4088-9725-f93f66fa4ec9 req-3404864c-a173-47e6-81d7-7b7dc0038951 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 07:59:58.166230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-4b3060b3-024d-4088-9725-f93f66fa4ec9 req-3404864c-a173-47e6-81d7-7b7dc0038951 service nova] Creating event network-changed:3a3f0e9f-714c-4d7f-8738-852d6e45f0b5 for instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 on hv-cinder-83602 Sep 07 07:59:58.175349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-4b3060b3-024d-4088-9725-f93f66fa4ec9 req-3404864c-a173-47e6-81d7-7b7dc0038951 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043347 Sep 07 07:59:58.175959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 309/637] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 07:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 07:59:58.288864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 07:59:58.296707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a988d51-1ac5-49ac-bafd-5d9c9b558b6a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1669 microversion: 2.1 time: 0.163061 Sep 07 07:59:58.297282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 329/638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 07:59:58 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:00.192571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-c1bcd659-8deb-41eb-93b2-4c3aa66505c2 req-e2fc4e7d-0adc-4c8d-ac94-8ce506879884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4aca7e-3298-4cfa-9690-01676e2e1ab1", "tag": "3a3f0e9f-714c-4d7f-8738-852d6e45f0b5"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:00.202014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-c1bcd659-8deb-41eb-93b2-4c3aa66505c2 req-e2fc4e7d-0adc-4c8d-ac94-8ce506879884 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:00.202493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-c1bcd659-8deb-41eb-93b2-4c3aa66505c2 req-e2fc4e7d-0adc-4c8d-ac94-8ce506879884 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:00.202921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-c1bcd659-8deb-41eb-93b2-4c3aa66505c2 req-e2fc4e7d-0adc-4c8d-ac94-8ce506879884 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:00.213765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-c1bcd659-8deb-41eb-93b2-4c3aa66505c2 req-e2fc4e7d-0adc-4c8d-ac94-8ce506879884 service nova] Creating event network-changed:3a3f0e9f-714c-4d7f-8738-852d6e45f0b5 for instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 on hv-cinder-83602 Sep 07 08:00:00.218665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-c1bcd659-8deb-41eb-93b2-4c3aa66505c2 req-e2fc4e7d-0adc-4c8d-ac94-8ce506879884 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031321 Sep 07 08:00:00.219240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 310/639] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:12.427572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:12.428550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:12.433269 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=13 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:12.434094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:12.440751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:12.441241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:12.441680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:12.442388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:12.442843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:12.443267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:12.467936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4aaa6a8f-af6c-47f2-88c6-73828079e11d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/ips" status: 200 len: 149 microversion: 2.1 time: 0.044765 Sep 07 08:00:12.468825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 330/640] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 08:00:12 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:13.816847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4823cf0-ded0-403e-b00b-6d8fbc41587a"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:13.819222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:13.821904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:13.822578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:13.828507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:13.828991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:13.829432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:13.830122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:13.830579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:13.831004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:14.260115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8f5124f4-e627-4e61-9b3b-9badd02131e7 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448423 Sep 07 08:00:14.260784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 311/641] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 08:00:13 2022] POST /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:21.795216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4823cf0-ded0-403e-b00b-6d8fbc41587a"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:21.797721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:21.803911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:21.804420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:21.804849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:21.805525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:21.805997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:21.806415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:21.946718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Invalid volume: volume a4823cf0-ded0-403e-b00b-6d8fbc41587a is already attached to instances: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: POST /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments HTTP/1.1 Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 74 Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:00:21.948454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {"volumeAttachment": {"volumeId": "a4823cf0-ded0-403e-b00b-6d8fbc41587a"}} Sep 07 08:00:21.950016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Invalid volume: volume a4823cf0-ded0-403e-b00b-6d8fbc41587a is already attached to instances: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'server_id': '6296be2b-713c-4cc7-9c5e-6ddd1388bdab', 'body': {'volumeAttachment': {'volumeId': 'a4823cf0-ded0-403e-b00b-6d8fbc41587a'}}} Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a4823cf0-ded0-403e-b00b-6d8fbc41587a is already attached to instances: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:21.950898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a4823cf0-ded0-403e-b00b-6d8fbc41587a is already attached to instances: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:21.952702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a4823cf0-ded0-403e-b00b-6d8fbc41587a is already attached to instances: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 400 to user: Invalid volume: volume a4823cf0-ded0-403e-b00b-6d8fbc41587a is already attached to instances: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9fad43e3-a874-42c2-8bdb-3f652c16e3c6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.158728 Sep 07 08:00:21.953946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 331/642] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 08:00:21 2022] POST /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments => generated 174 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 08:00:22.017120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:22.017698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:22.023805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:22.024329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:22.024763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:22.025442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:22.025889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:22.026308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:22.107234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lazy-loading 'services' on Instance uuid 6296be2b-713c-4cc7-9c5e-6ddd1388bdab {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:00:22.175665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-86060677-a1c0-4234-9e06-27a7f9e295dd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments/a4823cf0-ded0-403e-b00b-6d8fbc41587a" status: 202 len: 0 microversion: 2.1 time: 0.163680 Sep 07 08:00:22.176300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 312/643] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 08:00:22 2022] DELETE /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments/a4823cf0-ded0-403e-b00b-6d8fbc41587a => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:00:22.184576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:22.188059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:22.195031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:22.195514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:22.195944 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:22.196743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:22.197275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:22.197712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:22.228866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c894fd0-9008-45f3-bd04-c4fa59a92092 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Sep 07 08:00:22.229615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 332/644] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:00:22 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:00:23.242480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:23.244704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:23.250889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:23.251375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:23.251812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:23.252533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:23.252991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:23.253417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:23.283948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4b7a7ba3-f11c-47f8-87e6-1a0b94cdac73 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046185 Sep 07 08:00:23.284529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 313/645] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:00:23 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 08:00:23.348031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:23.348555 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:23.355087 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:23.355573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:23.356011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:23.356730 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:23.357189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:23.357628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:23.381805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:00:23.455729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7bea7cd-e967-47b2-9353-50e8538526c8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 204 len: 0 microversion: 2.1 time: 0.111139 Sep 07 08:00:23.456250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 333/646] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:00:23 2022] DELETE /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:00:23.466200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:23.470596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:23.476575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:23.477059 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:23.477495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:23.478191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:23.478646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:23.479103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:23.614467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:23.622209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0293418f-a3b5-4f16-a857-b7fcf0a1e101 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1681 microversion: 2.1 time: 0.161726 Sep 07 08:00:23.622766 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 314/647] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:23 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:24.646338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:24.646988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:24.653458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:24.653934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:24.655000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:24.655768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:24.656289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:24.656711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:24.788668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:24.796734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01c12397-0959-412a-9a9e-caa897e385fe tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1681 microversion: 2.1 time: 0.154765 Sep 07 08:00:24.797307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 334/648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:24 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:25.820410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:25.821022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:25.827854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:25.828378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:25.828822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:25.829521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:25.829979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:25.830407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:26.179008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:26.186739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9c2c45a5-9a03-4c6d-90bd-fab78a224ff3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1681 microversion: 2.1 time: 0.370135 Sep 07 08:00:26.187296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 315/649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:25 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1681 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:27.143006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-e127d153-abe2-481e-95cf-c26b423c0f35 req-0fdc91da-60b9-4aca-a555-5b63323fc63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6296be2b-713c-4cc7-9c5e-6ddd1388bdab", "name": "network-vif-deleted", "tag": "687b7420-4dbb-4f01-84f0-5827ccae5ed3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:27.153892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e127d153-abe2-481e-95cf-c26b423c0f35 req-0fdc91da-60b9-4aca-a555-5b63323fc63f service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:27.154977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e127d153-abe2-481e-95cf-c26b423c0f35 req-0fdc91da-60b9-4aca-a555-5b63323fc63f service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:27.155580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-e127d153-abe2-481e-95cf-c26b423c0f35 req-0fdc91da-60b9-4aca-a555-5b63323fc63f service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:27.167648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-e127d153-abe2-481e-95cf-c26b423c0f35 req-0fdc91da-60b9-4aca-a555-5b63323fc63f service nova] Creating event network-vif-deleted:687b7420-4dbb-4f01-84f0-5827ccae5ed3 for instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab on hv-cinder-83602 Sep 07 08:00:27.172713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-e127d153-abe2-481e-95cf-c26b423c0f35 req-0fdc91da-60b9-4aca-a555-5b63323fc63f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034795 Sep 07 08:00:27.173620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 335/650] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:27.210377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:27.211324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:27.219927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:27.220594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:27.221518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:27.222473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:27.223155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:27.223955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:27.297566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:27.306044 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5457dd12-6032-471b-b3c3-d556bb4e463f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 200 len: 1326 microversion: 2.1 time: 0.099456 Sep 07 08:00:27.308023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 316/651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:27 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:28.433916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:28.434615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:28.441678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:28.442156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:28.442587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:28.443330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:28.443783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:28.444230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:28.457675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab HTTP/1.1 Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:00:28.459264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:00:28.460804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '6296be2b-713c-4cc7-9c5e-6ddd1388bdab'} Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:00:28.461640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:00:28.463138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:28.464860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:00:28.464860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ee86421-76e1-47b6-b90e-49efe68bde64 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 404 len: 111 microversion: 2.1 time: 0.133252 Sep 07 08:00:28.464860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 336/652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:28 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:00:28.469635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-908e388f-c4d6-4d28-a165-acb246268422 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '.version_select at 0x7f831e9edee0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:28.487344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-908e388f-c4d6-4d28-a165-acb246268422 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656529207" status: 202 len: 0 microversion: 2.1 time: 0.021686 Sep 07 08:00:28.487891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 317/653] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Sep 7 08:00:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656529207 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 08:00:29.100649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1af7598-7477-4fde-b006-287f0979ddb8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: .version_select at 0x7f831e961b80>, body: {"keypair": {"name": "tempest-keypair-212630200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4SU6dlBCd5/45cFZa/xxmCWWP8U+jQD3+js9oUy9j/kMx+LVreqfLKXrEsKUIuyg0xDT609iK1MBTJ7gmj58JdOF9p+9n/Jt91z9BPGLWlG7ytQBl7OpOHS/qxYD49Xw=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:29.116380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-d1af7598-7477-4fde-b006-287f0979ddb8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:00:29.120187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-d1af7598-7477-4fde-b006-287f0979ddb8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:00:29.143354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d1af7598-7477-4fde-b006-287f0979ddb8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046512 Sep 07 08:00:29.143946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 337/654] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 08:00:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:30.363453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-71042048", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d7d7a39-e6a6-423e-b552-9ec48c064b08"}], "security_groups": [{"name": "tempest-securitygroup--1347950043"}], "key_name": "tempest-keypair-212630200", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:30.465930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] validate_networks() for [('3d7d7a39-e6a6-423e-b552-9ec48c064b08', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:00:30.927096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:00:30.927517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:00:30.927986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:00:30.928416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:00:30.928822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:00:30.937330 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:30.937807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:30.938236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:30.939215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:30.939665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:30.940102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:30.956626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:00:30.960512 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Getting quotas for user e07bc40275734f628fcc2f62dd4dd0e0 and project 09a6411dd18c4b6a8fad228058c8e06b. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:00:30.971781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:00:30.974054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:00:31.019789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9532a0d4-3333-485f-a1e6-f598fac055bd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662410 Sep 07 08:00:31.020530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 318/655] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:00:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 08:00:31.036276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f080d6e-df24-41ee-9084-91c7806f7b8c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:31.037589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f080d6e-df24-41ee-9084-91c7806f7b8c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:31.095448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5f080d6e-df24-41ee-9084-91c7806f7b8c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:31.102220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f080d6e-df24-41ee-9084-91c7806f7b8c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1239 microversion: 2.1 time: 0.070322 Sep 07 08:00:31.102970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 338/656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:31 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:32.126655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:32.127262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:32.134023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:32.134446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:32.134882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:32.135558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:32.136008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:32.136458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:32.200940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:32.208673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b5be2765-9e92-41f1-8d04-a029b68e22e9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1291 microversion: 2.1 time: 0.087340 Sep 07 08:00:32.209254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 319/657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:32 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1291 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:33.235359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:33.235982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:33.243491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:33.243984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:33.244488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:33.245158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:33.245782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:33.246358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:33.397452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:33.406113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-46bdf8f0-0052-49b3-b219-0be7c665e178 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.178090 Sep 07 08:00:33.406907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 339/658] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:33 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:33.978294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-b1a104d8-6653-4d37-b88d-0f0d2ffd82dc req-5ccb4819-bc8f-4d09-8e63-36c4e6b25185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787e574-99cb-4b1c-a959-6c1595193b84", "tag": "7ed9a1d9-5935-41b5-90dd-4dae497cc7e5"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:33.991462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b1a104d8-6653-4d37-b88d-0f0d2ffd82dc req-5ccb4819-bc8f-4d09-8e63-36c4e6b25185 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:33.991965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b1a104d8-6653-4d37-b88d-0f0d2ffd82dc req-5ccb4819-bc8f-4d09-8e63-36c4e6b25185 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:33.992424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b1a104d8-6653-4d37-b88d-0f0d2ffd82dc req-5ccb4819-bc8f-4d09-8e63-36c4e6b25185 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:34.004556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-b1a104d8-6653-4d37-b88d-0f0d2ffd82dc req-5ccb4819-bc8f-4d09-8e63-36c4e6b25185 service nova] Creating event network-changed:7ed9a1d9-5935-41b5-90dd-4dae497cc7e5 for instance c787e574-99cb-4b1c-a959-6c1595193b84 on hv-cinder-83602 Sep 07 08:00:34.009404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-b1a104d8-6653-4d37-b88d-0f0d2ffd82dc req-5ccb4819-bc8f-4d09-8e63-36c4e6b25185 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035765 Sep 07 08:00:34.009996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 320/659] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:34.430391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:34.431018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:34.437789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:34.438309 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:34.439005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:34.439702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:34.440191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:34.440623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:34.583977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:34.592342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62838748-f6c5-4bc1-924b-a9a09259556c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.165322 Sep 07 08:00:34.592909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 340/660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:34 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:34.870556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:34.871143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:34.878019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:34.878502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:34.878933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:34.879613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:34.880064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:34.880675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:34.903726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-99f49089-97ca-4512-81ba-0ef00d681f1a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/ips" status: 200 len: 151 microversion: 2.20 time: 0.137617 Sep 07 08:00:34.904516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 321/661] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Sep 7 08:00:34 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/ips => generated 151 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 08:00:35.615599 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:35.616244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:35.622556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:35.623037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:35.623468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:35.624184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:35.624647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:35.625057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:35.763801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:35.771746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ce9603b2-228f-415b-a7ac-c40840a0971d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.160171 Sep 07 08:00:35.772357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 341/662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:35 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:36.011503 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:36.012066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:36.019170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.019657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.020116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.020817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.021272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.021694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.103933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lazy-loading 'services' on Instance uuid 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:00:36.177605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dda6af59-2fd1-4c70-8369-82eb913b852f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments/3fee1d37-6c38-4421-a1b4-781f54ac7081" status: 202 len: 0 microversion: 2.1 time: 0.169907 Sep 07 08:00:36.178264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 322/663] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 08:00:36 2022] DELETE /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments/3fee1d37-6c38-4421-a1b4-781f54ac7081 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:00:36.187181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:36.189910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:36.198087 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.198549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.199003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.199684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.200176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.200593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.231820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0a10324-4776-4aef-9a1f-0581ab17b2eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Sep 07 08:00:36.232399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 342/664] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:00:36 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:36.709935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:36.710472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:36.716584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.717060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.717488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.718171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.718623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.719039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.743334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lazy-loading 'flavor' on Instance uuid 5b921f49-ab37-4207-8301-4d822f5cebaf {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:00:36.795380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:36.796739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:36.803257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.803820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.804485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.805192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.805655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.806077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.954207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:36.961618 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-623442dc-6bf0-4942-9607-bfc5ff506a0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/action" status: 202 len: 0 microversion: 2.20 time: 0.255820 Sep 07 08:00:36.962236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 323/665] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Sep 7 08:00:36 2022] POST /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:00:36.962740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2cdb3508-6a0d-49fc-82aa-c9895897419b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.171689 Sep 07 08:00:36.963302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 343/666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:36 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:36.970945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:36.971639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:36.977845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.978336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.978777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:36.979470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:36.979935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:36.980393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:37.128860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:37.137565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:37.139020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:37.140410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5c126e31-cc05-4a8b-974c-41407fa947ef tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.173750 Sep 07 08:00:37.141138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 324/667] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:36 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:37.245302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:37.247492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:37.253631 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:37.254112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:37.254542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:37.255233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:37.255769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:37.256225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:37.288158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd449459-cee4-45b0-8503-427b441eb219 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Sep 07 08:00:37.288925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 344/668] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:00:37 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:37.985208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:37.985813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:37.991724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:37.992242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:37.992683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:37.993370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:37.993825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:37.994250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.013874 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:38.129009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:38.136603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-128ae02e-8ac5-42ce-b581-e66a21138fb2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.155322 Sep 07 08:00:38.137160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 325/669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:37 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:38.166565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:38.167179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:38.173934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.174421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.174864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.175557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.176013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.176469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.301343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:38.303629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:38.309027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:38.309612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.310100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.310533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.311229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.312352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.312779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.318710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:38.320210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:38.321371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d318a0d-cd00-41ac-a366-8a5bd5b7cc6e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.158743 Sep 07 08:00:38.322057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 345/670] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:38 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:38.341888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cd559f85-fc23-4e1e-b440-0237206f8caa tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044524 Sep 07 08:00:38.342432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 326/671] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:00:38 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 08:00:38.421877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:38.422604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:38.429011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.429496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.429935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.430624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.431085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.431540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.457507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:00:38.507513 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:38.535477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ed4e87ef-07b1-422c-acc2-4f2cfa0f3b33 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 204 len: 0 microversion: 2.1 time: 0.117472 Sep 07 08:00:38.536296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 346/672] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:00:38 2022] DELETE /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:00:38.544837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:38.545480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:38.552244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.552737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.553179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.553899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.554359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.554787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.687905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:38.692389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-612340f8-9ee7-4214-a8cc-15dd3527aa29 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1689 microversion: 2.1 time: 0.151372 Sep 07 08:00:38.692963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 327/673] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:38 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:38.828794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-125ec33f-b98d-4e41-8d36-2b701dc3c8a9 req-0abb5751-6ede-4415-b2bc-361a0ef53f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787e574-99cb-4b1c-a959-6c1595193b84", "name": "network-vif-plugged", "status": "completed", "tag": "7ed9a1d9-5935-41b5-90dd-4dae497cc7e5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:38.838318 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-125ec33f-b98d-4e41-8d36-2b701dc3c8a9 req-0abb5751-6ede-4415-b2bc-361a0ef53f98 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:38.838806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-125ec33f-b98d-4e41-8d36-2b701dc3c8a9 req-0abb5751-6ede-4415-b2bc-361a0ef53f98 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:38.839300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-125ec33f-b98d-4e41-8d36-2b701dc3c8a9 req-0abb5751-6ede-4415-b2bc-361a0ef53f98 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:38.853152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-125ec33f-b98d-4e41-8d36-2b701dc3c8a9 req-0abb5751-6ede-4415-b2bc-361a0ef53f98 service nova] Creating event network-vif-plugged:7ed9a1d9-5935-41b5-90dd-4dae497cc7e5 for instance c787e574-99cb-4b1c-a959-6c1595193b84 on hv-cinder-83602 Sep 07 08:00:38.857838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-125ec33f-b98d-4e41-8d36-2b701dc3c8a9 req-0abb5751-6ede-4415-b2bc-361a0ef53f98 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033133 Sep 07 08:00:38.858528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 347/674] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:39.160071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:39.160714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:39.167255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:39.167765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:39.168242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:39.168927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:39.169377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:39.169869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:39.300164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:39.307682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b5621fba-7f96-4797-93b4-9df3afca0673 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.152250 Sep 07 08:00:39.308405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 328/675] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:39 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:39.348151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:39.348857 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:39.354949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:39.355430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:39.355865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:39.356574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:39.357031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:39.357456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:39.490586 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:39.498706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:39.500760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:39.501910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ea39c10-7ece-4789-933b-8880f5e2bca6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.158984 Sep 07 08:00:39.502466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 348/676] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:39 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:39.715584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:39.716146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:39.722065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:39.722546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:39.722982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:39.723662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:39.724138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:39.724564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:39.853517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:39.861728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-609e4922-2639-4bd2-87fc-8a7e18cc20eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1689 microversion: 2.1 time: 0.150052 Sep 07 08:00:39.862282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 329/677] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:39 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:40.329809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:40.330379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:40.336401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:40.336911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:40.337344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:40.338032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:40.338485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:40.338909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:40.471660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:40.479283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-77bbe19d-1206-408c-862b-2f12cadbb0a6 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.153652 Sep 07 08:00:40.479843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 349/678] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:40 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:40.527713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:40.528473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:40.535588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:40.536070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:40.536534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:40.537215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:40.537668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:40.538091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:40.667174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:40.675584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:40.677068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:40.678219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-45b2321c-e958-40a1-a491-5519e09ff422 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.154374 Sep 07 08:00:40.678771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 330/679] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:40 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:40.885305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:40.885898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:40.892876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:40.893362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:40.893798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:40.894486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:40.894935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:40.895360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.023696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:41.032001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c70ce16b-79c1-4ca3-8e8a-d6e9a96712eb tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1689 microversion: 2.1 time: 0.150539 Sep 07 08:00:41.032593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 350/680] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:40 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:41.169301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:41.172310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:41.174149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:41.174985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:41.180576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.181057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.181493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.182178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.182631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.183056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.213781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fb9b22a8-e660-40cd-aeac-3b79fe0253f8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048376 Sep 07 08:00:41.214340 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 331/681] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:00:41 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 08:00:41.277991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:41.278482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:41.281024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:41.286606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.287090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.287519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.288234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.288685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.289106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.314158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:00:41.386729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e37437a-7a85-4cee-a132-52d81a8ab4c1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 204 len: 0 microversion: 2.1 time: 0.112107 Sep 07 08:00:41.387307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 351/682] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:00:41 2022] DELETE /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:00:41.396260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:41.396862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:41.402740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.403217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.403644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.404360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.404815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.405832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.502767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:41.503507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:41.509450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.509940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.510503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.511076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.511538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.511962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.536734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:41.544513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b1f2194c-0bfd-4f80-8ea5-0675e2e83d61 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1675 microversion: 2.1 time: 0.152024 Sep 07 08:00:41.545270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 332/683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:41 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:41.647379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:41.655080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cdf29b43-5f0c-4879-b2d8-b048d32fba19 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.156948 Sep 07 08:00:41.655666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 352/684] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:41 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:41.703909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:41.704540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:41.710447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.710925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.711357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.712044 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:41.712523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:41.712950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:41.840616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:41.848686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:41.850161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:41.851309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-636a3067-9a90-41dc-9d51-5aafe578c441 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.152159 Sep 07 08:00:41.851858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 333/685] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:41 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:42.055059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:42.055667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:42.062254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.062732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.063158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:42.064119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.064570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.064992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:42.193339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:42.200881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f008190-a498-4767-82c6-f43f22cbc10a tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1689 microversion: 2.1 time: 0.149681 Sep 07 08:00:42.201442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 353/686] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:42 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:42.567944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:42.568587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:42.575053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.575533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.575967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:42.576676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.577190 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.577702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:42.678197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:42.678948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:42.681512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:42.687496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.688073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.688864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:42.689571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.690031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.690459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:42.711777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:42.720319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b6053c2d-e4c0-4c6e-9e79-5de1cc8d8b59 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1675 microversion: 2.1 time: 0.156496 Sep 07 08:00:42.720883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 334/687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:42 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:42.836414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:42.845056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a4d24c2-e2d1-439f-a846-b7678702c3f9 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.170641 Sep 07 08:00:42.845627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 354/688] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:42 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:42.876055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:42.876695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:42.882539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.883022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.883458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:42.884172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:42.884629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:42.885056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:43.015081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:43.023125 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:43.024617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:43.025745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-256fef95-f399-4a64-b81b-ce06c022decc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.153988 Sep 07 08:00:43.026300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 335/689] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:42 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:43.223837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:43.224391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:43.230354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:43.230842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:43.231274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:43.231962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:43.232450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:43.232895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:43.362879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:43.370494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4be9ecba-86e1-4f77-b6ef-1a83caa8cbdc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1689 microversion: 2.1 time: 0.150661 Sep 07 08:00:43.371057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 355/690] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:43 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:43.743786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:43.744416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:43.751022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:43.751510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:43.751938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:43.752663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:43.753117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:43.753535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:43.868321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:43.868930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:43.876027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:43.876543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:43.876973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:43.877668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:43.878117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:43.878533 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:44.024764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:44.033319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9360bd2c-b092-499b-9129-12358125ac7e tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.168829 Sep 07 08:00:44.034163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 356/691] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:43 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:44.056505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:44.057140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:44.064747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:44.065243 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:44.065683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:44.066391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:44.066850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:44.067278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:44.129871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:44.138093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e12eff74-27d8-46ea-bc31-5a806b809d18 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1675 microversion: 2.1 time: 0.398481 Sep 07 08:00:44.138659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 336/692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:43 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1675 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:44.204215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:44.212154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:44.213589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:44.214719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53b7157f-fb87-4376-84a3-7616ea3c019b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.162511 Sep 07 08:00:44.215274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 357/693] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:44 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:44.393740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:44.394353 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:44.396354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:44.401473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:44.401959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:44.402392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:44.403086 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:44.403543 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:44.403966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:44.831492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:44.839403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e7b20861-5529-4d8a-85b7-6cf47a4c2551 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1689 microversion: 2.1 time: 0.449519 Sep 07 08:00:44.839970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 337/694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:44 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1689 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:45.058308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:45.058873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:45.065998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.066486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.066917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.067607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.068131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.068558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.164094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:45.164859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:45.173621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.175040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.175592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.177231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.177776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.178278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.213029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:45.221979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c6739965-d0e4-4881-86ae-48e9b953cf1d tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.167666 Sep 07 08:00:45.222883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 358/695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:45 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:45.241750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:45.242440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:45.249275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.249830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.250356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.251110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.251633 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.252151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.383105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:45.392272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:45.393789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:45.394942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ccd0ed52-304a-4f33-81cf-f884b173ac0f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.157321 Sep 07 08:00:45.395490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 359/696] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:45 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:00:45.457062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:45.464901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7abffb02-2574-4075-8fad-ec28d8a200bd tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1675 microversion: 2.1 time: 0.304915 Sep 07 08:00:45.465474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 338/697] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:45 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1675 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:45.864777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:45.866195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:45.885200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.886575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.887048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.887803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:45.888300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:45.888736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:45.987781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:45.998772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e092a863-f7aa-4365-9d8f-e046fda28312 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1622 microversion: 2.1 time: 0.137892 Sep 07 08:00:46.000503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 360/698] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:45 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1622 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:46.233083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6e0dd014-2292-4872-87de-027432a61ce3 req-8045559d-a916-479c-983a-e337c735308c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4aca7e-3298-4cfa-9690-01676e2e1ab1", "name": "network-vif-deleted", "tag": "3a3f0e9f-714c-4d7f-8738-852d6e45f0b5"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:46.245609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:46.246218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:46.249449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6e0dd014-2292-4872-87de-027432a61ce3 req-8045559d-a916-479c-983a-e337c735308c service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:46.250420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6e0dd014-2292-4872-87de-027432a61ce3 req-8045559d-a916-479c-983a-e337c735308c service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:46.251082 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6e0dd014-2292-4872-87de-027432a61ce3 req-8045559d-a916-479c-983a-e337c735308c service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:46.270422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:46.271325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:46.272272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:46.273166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:46.276045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:46.276724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:46.278582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6e0dd014-2292-4872-87de-027432a61ce3 req-8045559d-a916-479c-983a-e337c735308c service nova] Creating event network-vif-deleted:3a3f0e9f-714c-4d7f-8738-852d6e45f0b5 for instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 on hv-cinder-83602 Sep 07 08:00:46.287003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6e0dd014-2292-4872-87de-027432a61ce3 req-8045559d-a916-479c-983a-e337c735308c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130755 Sep 07 08:00:46.288355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 339/699] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:46.421247 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:46.422318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:46.428838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:46.439606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1fad35ef-f3bf-43e7-b58a-9c57bc16980b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1365 microversion: 2.1 time: 0.198469 Sep 07 08:00:46.442157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:46.456470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 361/700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:46 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:46.457238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:46.457695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:46.458443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:46.458903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:46.459327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:46.489518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:46.490237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:46.501511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:46.502011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:46.502443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:46.503159 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:46.506776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:46.507229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:46.548898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:46.634767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:46.644462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-badd88f8-eee7-4eb8-8a7e-970ef31a35e6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1608 microversion: 2.1 time: 0.159548 Sep 07 08:00:46.657129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 362/701] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:46 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:46.698999 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:46.709601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:46.711058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:46.712466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4e82310f-fb58-463a-9529-b285dccf169f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.295815 Sep 07 08:00:46.713283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 340/702] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:46 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:00:47.022860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:47.023465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:47.029510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.030172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.030611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.031297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.031749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.032196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.064840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.065322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.065754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.066201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lazy-loading 'fault' on Instance uuid 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:00:47.111376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:47.119261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b14a5f0-2d68-4e8d-8358-c1d718971bcc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 200 len: 1335 microversion: 2.1 time: 0.100244 Sep 07 08:00:47.119835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 363/703] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:47 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:47.469548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:47.470257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:47.476742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.477298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.477800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.478606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.479148 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.479636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.620612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:47.629151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ee157e4a-689a-4c8b-bb81-d9e2de3a34f8 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1555 microversion: 2.1 time: 0.164213 Sep 07 08:00:47.629715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 341/704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:47 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:47.651962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:47.652477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:47.658994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.659475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.659903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.660630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.661084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.661503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.669804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:47.670487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:47.676642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.677128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.677569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.678265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.678723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.679153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.711502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.711988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.712453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.712902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lazy-loading 'fault' on Instance uuid e625ca1a-4906-44bc-afe5-092b2f95c4d9 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:00:47.715740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:47.739836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c33c0f1e-bbc9-4928-bdbc-d3c77f21b0ae tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091734 Sep 07 08:00:47.740475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 364/705] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 08:00:47 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:47.745122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:47.745658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:47.753091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.753578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.754007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.754886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:47.755364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:47.755500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:47.755909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:47.763845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c06b7b7f-de4a-443f-a4ae-d294d2a35bea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 200 len: 1328 microversion: 2.1 time: 0.097888 Sep 07 08:00:47.765323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 342/706] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:47 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:48.027798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:48.038838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:48.040679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:48.042482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d9bef10-b802-432f-b26c-6ca216c1401f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.300919 Sep 07 08:00:48.043333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 365/707] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:47 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:48.142820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:48.143427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: 9a4aca7e-3298-4cfa-9690-01676e2e1ab1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:48.149881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:48.150463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:48.150901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:48.151591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:48.152048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:48.152507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:48.167278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] HTTP exception thrown: Instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 could not be found. Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Request method failure captured: Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 HTTP/1.1 Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5sTGRLiOMZ9BztMknjwb1bTtmawAr05yKxmMY6XSOU-KGdsmV2iVQKqW9_UUIk6hFZCmT4z6YqxgGZt599G6X9iaYWqSu0TMD3sA6Re6ROAEQYf9ZHymvf2WTN82nDB54vuXv7oje7dmNjBVjSQD6pA5gfJ7cozNzZVvgrcxmLLHk Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:00:48.169022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4d3d7139782f4b63ac6dc8d4618abe64", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: b52ececfc19b41b5b8387dc6908d4a4a Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 could not be found. Sep 07 08:00:48.171002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '9a4aca7e-3298-4cfa-9690-01676e2e1ab1'} Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 could not be found. Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:00:48.171807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 could not be found. Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 could not be found. Sep 07 08:00:48.173889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.175784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Returning 404 to user: Instance 9a4aca7e-3298-4cfa-9690-01676e2e1ab1 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:00:48.175784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ab4448e9-f0d1-4074-adb3-914ce43fdcb7 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1" status: 404 len: 111 microversion: 2.1 time: 0.031559 Sep 07 08:00:48.175784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 343/708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:48 2022] GET /compute/v2.1/servers/9a4aca7e-3298-4cfa-9690-01676e2e1ab1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:00:48.180430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-58513255-e7ff-4f84-95e0-8120b37d3061 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '.version_select at 0x7f831e8f01f0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:48.201087 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-58513255-e7ff-4f84-95e0-8120b37d3061 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-546569741" status: 202 len: 0 microversion: 2.1 time: 0.024401 Sep 07 08:00:48.201696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 366/709] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Sep 7 08:00:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-546569741 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:00:48.308585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-15402409-2ec4-4098-b83f-b26077109c50 req-3a0fdd19-d2b3-490a-80d0-1b2901aaebed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e625ca1a-4906-44bc-afe5-092b2f95c4d9", "name": "network-vif-deleted", "tag": "e9177b89-1981-44ee-94b6-ba5c779c2297"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:48.318578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-15402409-2ec4-4098-b83f-b26077109c50 req-3a0fdd19-d2b3-490a-80d0-1b2901aaebed service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:48.319061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-15402409-2ec4-4098-b83f-b26077109c50 req-3a0fdd19-d2b3-490a-80d0-1b2901aaebed service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:48.319492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-15402409-2ec4-4098-b83f-b26077109c50 req-3a0fdd19-d2b3-490a-80d0-1b2901aaebed service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:48.332270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-15402409-2ec4-4098-b83f-b26077109c50 req-3a0fdd19-d2b3-490a-80d0-1b2901aaebed service nova] Creating event network-vif-deleted:e9177b89-1981-44ee-94b6-ba5c779c2297 for instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 on hv-cinder-83602 Sep 07 08:00:48.337317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-15402409-2ec4-4098-b83f-b26077109c50 req-3a0fdd19-d2b3-490a-80d0-1b2901aaebed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Sep 07 08:00:48.338422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 344/710] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:00:48.790960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:48.791576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:48.799293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:48.799877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:48.800434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:48.801426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:48.801945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:48.802527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:48.819428 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] HTTP exception thrown: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Request method failure captured: Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 HTTP/1.1 Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE7QI0A9wbklRJuku3Wgli2W_n19aHuSVL19Ek-etQsU0_amv4PZREIQvYf0oyMSkRtSlcCh9RdHQ66jh8wuMz354isea5GnOYU31WZM-MbLH2KpXfCKEE4ut3UiTS6mr3Sn0D0D1cbtXMTUKdpxQM2Ne7JeqHL_ObeWnmdN7r0eS6Y Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:00:48.821469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3264396aada44ba89f39cfe0776e183e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 55b97e954da94f909f8f5ffff515509e Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:00:48.823111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'e625ca1a-4906-44bc-afe5-092b2f95c4d9'} Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:00:48.824007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:00:48.825472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:00:48.826907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Returning 404 to user: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:00:48.828250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-282a6e14-15de-4d5d-8f37-1b3d79ef5f0e tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 404 len: 111 microversion: 2.1 time: 0.042868 Sep 07 08:00:48.829118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 367/711] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:48 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:00:48.838392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-917cd29c-9248-4636-a193-5e726a5c717b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '.version_select at 0x7f831ea94160>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:48.860912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-917cd29c-9248-4636-a193-5e726a5c717b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486736810" status: 202 len: 0 microversion: 2.1 time: 0.027084 Sep 07 08:00:48.867257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 345/712] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Sep 7 08:00:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486736810 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:00:49.070269 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:49.071003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:49.079170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:49.079619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:49.080064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:49.081888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:49.082538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:49.083136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:49.166142 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-7d150968-b6df-42e6-a5b4-38ae501e4630 req-31b0d387-09c5-411a-9489-e3c6b459a21e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787e574-99cb-4b1c-a959-6c1595193b84", "tag": "7ed9a1d9-5935-41b5-90dd-4dae497cc7e5"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:49.184509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7d150968-b6df-42e6-a5b4-38ae501e4630 req-31b0d387-09c5-411a-9489-e3c6b459a21e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:49.186590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7d150968-b6df-42e6-a5b4-38ae501e4630 req-31b0d387-09c5-411a-9489-e3c6b459a21e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:49.187458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-7d150968-b6df-42e6-a5b4-38ae501e4630 req-31b0d387-09c5-411a-9489-e3c6b459a21e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:49.206887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-7d150968-b6df-42e6-a5b4-38ae501e4630 req-31b0d387-09c5-411a-9489-e3c6b459a21e service nova] Creating event network-changed:7ed9a1d9-5935-41b5-90dd-4dae497cc7e5 for instance c787e574-99cb-4b1c-a959-6c1595193b84 on hv-cinder-83602 Sep 07 08:00:49.213490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-7d150968-b6df-42e6-a5b4-38ae501e4630 req-31b0d387-09c5-411a-9489-e3c6b459a21e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166815 Sep 07 08:00:49.214774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 368/713] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:49.246799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:49.247945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:49.273682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:49.276314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:49.277103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:49.278141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:49.278288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:49.278925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:49.279618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:49.295434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:49.298750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:49.300262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b5bcbfeb-44e8-48d3-a4bb-48abdde9ae7d tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.233993 Sep 07 08:00:49.301564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 346/714] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:49 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:00:49.322418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lazy-loading 'flavor' on Instance uuid a500c169-e521-4f76-b825-f3c52a0583fb {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:00:49.427002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-58b753de-15d2-449b-a4fd-6c548d15b237 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "POST /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb/action" status: 202 len: 0 microversion: 2.1 time: 0.182675 Sep 07 08:00:49.427726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 369/715] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 08:00:49 2022] POST /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:00:49.443274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:49.449083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:49.468379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:49.469318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:49.470007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:49.470994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:49.471880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:49.472542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:49.653890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:49.667495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-539c5f4d-b505-4fed-87c0-36506e1eddae tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.235185 Sep 07 08:00:49.685258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 347/716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:49 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:49.708348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c12b290-963c-4ed9-bbe8-0df252bbbaf8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'create', calling method: .version_select at 0x7f831e8f0310>, body: {"keypair": {"name": "tempest-keypair-562315082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5uON1ZXg4DK6++hhJLGYWpGbQDs94dYZQhq7Z4XdvPhRKyVMYujKvo+mKqjwAo/WEvnydItt10mf4cyXcyUtnXC4+bQuGVftEMG5hYvszH56GHLKH2yUg1zWEnNIDaBA=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:49.724613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-6c12b290-963c-4ed9-bbe8-0df252bbbaf8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for project 3264396aada44ba89f39cfe0776e183e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:00:49.728711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-6c12b290-963c-4ed9-bbe8-0df252bbbaf8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for user 55b97e954da94f909f8f5ffff515509e and project 3264396aada44ba89f39cfe0776e183e. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:00:49.752493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c12b290-963c-4ed9-bbe8-0df252bbbaf8 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048330 Sep 07 08:00:49.756313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 370/717] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 08:00:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:50.327125 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:50.328428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:50.334978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:50.335469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:50.336101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:50.336966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:50.337645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:50.338025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:50.508305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:50.520120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:50.522015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:50.523465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-90e6b789-0d6b-4d58-b5df-146df80d508f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.200541 Sep 07 08:00:50.524382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 348/718] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:50 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:50.696611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:50.697276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:50.704799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:50.705297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:50.705740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:50.706446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:50.706907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:50.707342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:50.916486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:50.925557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-49ba67e0-34c7-4cc5-ae2d-e38d5b041245 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.233406 Sep 07 08:00:50.926178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 371/719] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:50 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:51.249224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:51.249735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:51.255686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.256202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.256638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.257328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.257781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.258205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.283735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-553823921", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26a64bc8-5c6b-4a41-8bf0-7f007c3b1bce"}], "security_groups": [{"name": "tempest-securitygroup--1121493731"}], "key_name": "tempest-keypair-562315082", "user_data": "}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:51.284463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:00:51.364851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-41f64766-e20e-459e-a9c1-8d7d245931ef tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 204 len: 0 microversion: 2.1 time: 0.119556 Sep 07 08:00:51.369421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 349/720] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:00:51 2022] DELETE /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:00:51.374646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:51.375466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:51.381388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.381871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.382363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.383243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.383696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.384132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.402996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] validate_networks() for [('26a64bc8-5c6b-4a41-8bf0-7f007c3b1bce', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:00:51.518805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:51.526480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-79d2401e-e59b-42bf-a44c-38f70c718a05 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1507 microversion: 2.1 time: 0.156598 Sep 07 08:00:51.527052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 350/721] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:51 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:51.549122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:51.549750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:51.555729 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.556242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.556679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.557363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.557818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.558235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.692966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:51.702013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:51.703437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:51.704604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-05a7539d-8fa8-4705-b1f0-06a1a72509a6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.159519 Sep 07 08:00:51.705160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 351/722] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:51 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:00:51.832836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:00:51.833315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:00:51.833712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:00:51.834118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:00:51.834524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:00:51.843489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.843965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.844437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.845156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.845611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.846029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.862706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for project 3264396aada44ba89f39cfe0776e183e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:00:51.866602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Getting quotas for user 55b97e954da94f909f8f5ffff515509e and project 3264396aada44ba89f39cfe0776e183e. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:00:51.877895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:00:51.880106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:00:51.926482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-042dc98d-394f-465a-9f41-9989a6bf284b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647514 Sep 07 08:00:51.927136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 372/723] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:00:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 08:00:51.938794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-95709826-24ad-4940-a30d-a37f111613c9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:51.939400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-95709826-24ad-4940-a30d-a37f111613c9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:51.949237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:51.949958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:51.957558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.958022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.959094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.959828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:51.960453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:51.960893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:51.994908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95709826-24ad-4940-a30d-a37f111613c9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:52.003736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-95709826-24ad-4940-a30d-a37f111613c9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1236 microversion: 2.1 time: 0.069525 Sep 07 08:00:52.004651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 352/724] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:51 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:52.107422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:52.115970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-216a0082-10f2-40dc-99dc-7edefe54ab75 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.171145 Sep 07 08:00:52.116582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 373/725] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:51 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:52.549906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:52.550438 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:52.556816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:52.557301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:52.557740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:52.558429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:52.558886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:52.559316 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:52.687889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:52.695690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-44483fc0-c7bb-4799-9f83-022241d356f6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1507 microversion: 2.1 time: 0.150499 Sep 07 08:00:52.696273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 353/726] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:52 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:52.729192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:52.729803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:52.736889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:52.737373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:52.737807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:52.738497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:52.738952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:52.739375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:52.872535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:52.881354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:52.882810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:52.883959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-af73b33e-5f02-4f68-ad61-765a91324e2f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.158642 Sep 07 08:00:52.884552 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 374/727] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:52 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:53.026042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:53.026651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:53.032992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.033481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.033923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:53.034625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.035115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.035542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:53.097408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:53.104969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4856f2d9-d084-4d97-890c-2d02a2b42523 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1240 microversion: 2.1 time: 0.082788 Sep 07 08:00:53.105537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 354/728] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:53 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:53.140459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:53.141113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:53.147062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.147565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.147994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:53.148694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.149143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.149560 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:53.277644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:53.285723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c6dee1c-b330-44e8-882d-991dedd5405f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.149969 Sep 07 08:00:53.286296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 375/729] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:53 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:53.719103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:53.719644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:53.725743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.726231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.726673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:53.727363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.727824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.728282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:53.863442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:53.871202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a269e21d-1d93-4636-b96d-e402215453bc tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1507 microversion: 2.1 time: 0.156599 Sep 07 08:00:53.871765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 355/730] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:53 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:53.911113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:53.911698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:53.918080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.918557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.918984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:53.919669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:53.920146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:53.921143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.061800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:54.070958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:54.073259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:54.074432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-09363c8c-44d1-4406-8b27-873f4e18378b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1745 microversion: 2.20 time: 0.167218 Sep 07 08:00:54.074993 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 376/731] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:53 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:54.127052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:54.127673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:54.133887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.134494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.134940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.135634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.136280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.136699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.229843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:54.237446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a0148b13-5cd0-4353-a6e6-0a08dbbebbfb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1288 microversion: 2.1 time: 0.114308 Sep 07 08:00:54.238006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 356/732] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:54 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1288 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:54.309277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:54.309881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:54.316528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.317006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.317433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.318120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.318569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.318987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.466000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:54.476369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6aa64e52-40a6-4f9d-b6dd-502203fbe3c4 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.170806 Sep 07 08:00:54.480465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 377/733] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:54 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:54.517131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-655a5580-be21-41e8-8ddd-2ac92e758f51 req-0ee38fa7-84d8-4707-8e8d-c6057178d222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e63064-b3e0-4870-b57d-c075177e98ce", "name": "network-vif-deleted", "tag": "d2f19dac-b216-473d-b233-7f59237c680e"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:54.528175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-655a5580-be21-41e8-8ddd-2ac92e758f51 req-0ee38fa7-84d8-4707-8e8d-c6057178d222 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.528896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-655a5580-be21-41e8-8ddd-2ac92e758f51 req-0ee38fa7-84d8-4707-8e8d-c6057178d222 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.530188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-655a5580-be21-41e8-8ddd-2ac92e758f51 req-0ee38fa7-84d8-4707-8e8d-c6057178d222 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.546149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-655a5580-be21-41e8-8ddd-2ac92e758f51 req-0ee38fa7-84d8-4707-8e8d-c6057178d222 service nova] Creating event network-vif-deleted:d2f19dac-b216-473d-b233-7f59237c680e for instance d3e63064-b3e0-4870-b57d-c075177e98ce on hv-cinder-83602 Sep 07 08:00:54.553481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-655a5580-be21-41e8-8ddd-2ac92e758f51 req-0ee38fa7-84d8-4707-8e8d-c6057178d222 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040138 Sep 07 08:00:54.554282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 357/734] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:54.895902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:54.897598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:54.903723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.904298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.904747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.906086 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.906542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.906989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.940285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:54.940911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:54.941189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:54.941650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lazy-loading 'fault' on Instance uuid d3e63064-b3e0-4870-b57d-c075177e98ce {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:00:54.984828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:54.992719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7284cc2-e406-4d93-a0db-f6ee509843b5 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 200 len: 1311 microversion: 2.1 time: 0.101159 Sep 07 08:00:54.993297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 378/735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:54 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:55.102551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:55.103527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:55.112613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:55.113595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:55.114674 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:55.115533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:55.116185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:55.116607 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:55.260895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:55.261588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:55.268496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:55.269057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:55.269561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:55.270350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:55.270861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:55.271356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:55.337307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:55.346045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9691fd37-6381-49d3-9acd-b8d1daa69fc9 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1294 microversion: 2.1 time: 0.089251 Sep 07 08:00:55.346781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 379/736] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:55 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:55.354218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:55.363371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:55.364843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:55.366015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-986b3a9f-00bf-4bf6-b942-346783675a56 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1745 microversion: 2.20 time: 0.268438 Sep 07 08:00:55.366546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 358/737] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:55 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1745 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:55.498979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:55.507121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:55.515461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:55.516317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:55.516967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:55.517859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:55.518325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:55.519150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:55.658686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:55.662703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:55.668407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17277719-9b0c-4726-8684-664ec556192a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.173196 Sep 07 08:00:55.669164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 380/738] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:55 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:56.015048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:56.015844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: d3e63064-b3e0-4870-b57d-c075177e98ce] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:56.021940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.022708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.023288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.024104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.025807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.025807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.039891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] HTTP exception thrown: Instance d3e63064-b3e0-4870-b57d-c075177e98ce could not be found. Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Request method failure captured: Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce HTTP/1.1 Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5sTGRLiOMZ9BztMknjwb1bTtmawAr05yKxmMY6XSOU-KGdsmV2iVQKqW9_UUIk6hFZCmT4z6YqxgGZt599G6X9iaYWqSu0TMD3sA6Re6ROAEQYf9ZHymvf2WTN82nDB54vuXv7oje7dmNjBVjSQD6pA5gfJ7cozNzZVvgrcxmLLHk Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:00:56.041600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4d3d7139782f4b63ac6dc8d4618abe64", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: b52ececfc19b41b5b8387dc6908d4a4a Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance d3e63064-b3e0-4870-b57d-c075177e98ce could not be found. Sep 07 08:00:56.043149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': 'd3e63064-b3e0-4870-b57d-c075177e98ce'} Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e63064-b3e0-4870-b57d-c075177e98ce could not be found. Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:00:56.044010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e63064-b3e0-4870-b57d-c075177e98ce could not be found. Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e63064-b3e0-4870-b57d-c075177e98ce could not be found. Sep 07 08:00:56.045413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:00:56.047928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Returning 404 to user: Instance d3e63064-b3e0-4870-b57d-c075177e98ce could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:00:56.048820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6fb57b2a-d849-4070-b8c4-dfd84662c839 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce" status: 404 len: 111 microversion: 2.1 time: 0.037978 Sep 07 08:00:56.049389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 359/739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:56 2022] GET /compute/v2.1/servers/d3e63064-b3e0-4870-b57d-c075177e98ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:00:56.057455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:56.058467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:56.066271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.067076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.067516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.068286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.068748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.069180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.095220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:00:56.174953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a8d761d-95a4-4c78-81ff-a61b06ec6719 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 204 len: 0 microversion: 2.1 time: 0.120784 Sep 07 08:00:56.175826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 381/740] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:00:56 2022] DELETE /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:00:56.185633 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:56.187751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:56.195331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.195817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.196292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.197006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.197463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.197890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.371108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:56.371803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:56.378671 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.379172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.379608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.380387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.381381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.381381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.451141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:56.459460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-49286781-af12-427a-bca7-461062edfdb9 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.278560 Sep 07 08:00:56.467081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 360/741] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:56 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:56.472399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:56.473186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:56.480558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.481145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.481677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.482483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.483049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.484257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.523003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:56.530734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b83975b1-8672-4e09-8918-11e7feeec46a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.163789 Sep 07 08:00:56.531517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 382/742] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:56 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:56.686587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-750757ee-8f5a-4646-b813-adcf8957fb68 req-dafc882b-43ae-440d-afaf-7acd8733073d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ac8466-b0bf-4936-a910-9ac7e096614e", "tag": "dc6d946d-0223-4317-bea3-d7cb4c7d36d3"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:56.688509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:56.696941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-750757ee-8f5a-4646-b813-adcf8957fb68 req-dafc882b-43ae-440d-afaf-7acd8733073d service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.697306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:56.697446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-750757ee-8f5a-4646-b813-adcf8957fb68 req-dafc882b-43ae-440d-afaf-7acd8733073d service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.697838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-750757ee-8f5a-4646-b813-adcf8957fb68 req-dafc882b-43ae-440d-afaf-7acd8733073d service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.698737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:56.699904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2f020cf1-4be1-4fd3-b745-a1b3f4210e1e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1745 microversion: 2.20 time: 0.238614 Sep 07 08:00:56.700488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 361/743] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:56 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:56.712307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:56.712307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:56.712307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.712307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.712708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.713510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:56.714136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:56.714568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:56.721864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:56.722177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-750757ee-8f5a-4646-b813-adcf8957fb68 req-dafc882b-43ae-440d-afaf-7acd8733073d service nova] Creating event network-changed:dc6d946d-0223-4317-bea3-d7cb4c7d36d3 for instance 07ac8466-b0bf-4936-a910-9ac7e096614e on hv-cinder-83602 Sep 07 08:00:56.727175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-750757ee-8f5a-4646-b813-adcf8957fb68 req-dafc882b-43ae-440d-afaf-7acd8733073d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044691 Sep 07 08:00:56.728073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 383/744] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:00:56.852619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:56.861171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-77d76b27-61e4-4953-8d06-5bb8d2c5f2f7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.159748 Sep 07 08:00:56.861729 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 362/745] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:56 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:57.141384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-4da8d0c4-69c0-45a8-9747-51de006e4d88 req-c05b8305-f196-4e07-8530-452d5dde2252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b921f49-ab37-4207-8301-4d822f5cebaf", "name": "network-vif-plugged", "status": "completed", "tag": "e8074f9b-36f4-44cb-a791-0408a89aa4d8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:00:57.151389 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4da8d0c4-69c0-45a8-9747-51de006e4d88 req-c05b8305-f196-4e07-8530-452d5dde2252 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.151867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4da8d0c4-69c0-45a8-9747-51de006e4d88 req-c05b8305-f196-4e07-8530-452d5dde2252 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.152314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-4da8d0c4-69c0-45a8-9747-51de006e4d88 req-c05b8305-f196-4e07-8530-452d5dde2252 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.164387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-4da8d0c4-69c0-45a8-9747-51de006e4d88 req-c05b8305-f196-4e07-8530-452d5dde2252 service nova] Creating event network-vif-plugged:e8074f9b-36f4-44cb-a791-0408a89aa4d8 for instance 5b921f49-ab37-4207-8301-4d822f5cebaf on hv-cinder-83602 Sep 07 08:00:57.169099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-4da8d0c4-69c0-45a8-9747-51de006e4d88 req-c05b8305-f196-4e07-8530-452d5dde2252 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032957 Sep 07 08:00:57.169681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 384/746] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:00:57.483360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:57.484030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:57.490410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.490887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.491316 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.492005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.492488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.492907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.554124 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:57.554828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:57.556957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:00:57.563444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.563937 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.564406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.565110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.565574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.566004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.626343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:57.634160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b2365885-bef9-40e7-8326-ef0cf9b25ed2 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.154605 Sep 07 08:00:57.634650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 363/747] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:57 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:57.703233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:57.710785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-862598ab-fc8b-4065-9b81-fa9f16a1fe79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.161172 Sep 07 08:00:57.711344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 385/748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:57 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:57.728002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:57.728650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:57.734630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.735117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.735551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.736277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.736737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.737170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.869008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:57.877195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:57.878686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:57.879851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c0020f0d-372d-4ff7-8b53-f1867c03e1f9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1745 microversion: 2.20 time: 0.155751 Sep 07 08:00:57.880460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 364/749] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:57 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:57.887359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:57.887359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:57.891232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.891721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.892182 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:57.892871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:57.893328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:57.893755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:58.026303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:58.034756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a44dae9e-32b3-4726-b398-4e57dcfcafec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.154761 Sep 07 08:00:58.035332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 386/750] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:57 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:58.656987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:58.657500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:58.664055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:58.664585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:58.665012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:58.665685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:58.666132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:58.666549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:58.735009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:58.735649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:58.742077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:58.742569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:58.743005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:58.743702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:58.744183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:58.744610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:58.797433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:58.805215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-da83b0d6-1944-410d-868f-6a392dd0bef1 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.152265 Sep 07 08:00:58.805782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 365/751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:58 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:00:58.884009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:58.891644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-716411e7-3d39-4470-add4-f2dcd58d5e48 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.161478 Sep 07 08:00:58.892219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 387/752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:58 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:58.906403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:58.907060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:58.912966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:58.913443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:58.913879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:58.914565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:58.915033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:58.915441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:59.054980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:59.056988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:59.057592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:59.063598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:59.063791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:59.064274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:59.064704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:59.065086 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:59.065385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:59.065867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:59.066234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-702cbb32-d15d-4d53-808f-d2ee632a6167 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1745 microversion: 2.20 time: 0.164293 Sep 07 08:00:59.066350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:59.066788 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 366/753] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:00:58 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:00:59.207845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:00:59.215922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-139c3d55-9821-404f-be26-4913922a64d1 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.162829 Sep 07 08:00:59.216520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 388/754] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:59 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:00:59.829189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:59.829789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:59.836264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:59.836751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:59.837188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:59.837879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:59.838333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:59.838760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:59.913985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:00:59.914622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:00:59.921698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:59.922184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:59.922619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:00:59.923304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:00:59.923762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:00:59.924211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:00.065101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:00.074646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e3de9bab-123b-44c5-ade3-9a370ef604fa tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.164324 Sep 07 08:01:00.075470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 389/755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:59 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:01:00.091837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:00.092490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:00.100453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:00.100918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:00.101385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:00.102252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:00.102713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:00.103142 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:00.121546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:00.130995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-954e3c2d-dee3-49fe-9aaa-e9e569b0a391 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.305784 Sep 07 08:01:00.132146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 367/756] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:00:59 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:00.241127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:00.242117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:00.250592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:00.251150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:00.251803 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:00.252715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:00.253603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:00.254236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:00.262165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:00.271948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:00.274617 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:00.277068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c988dc91-6b93-4288-b383-5998ca94d200 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.189627 Sep 07 08:01:00.293112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 390/757] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:00 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:00.758878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:00.779771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b60e7b3d-eb36-4eac-b61d-38b7347364b7 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.544655 Sep 07 08:01:00.781114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 368/758] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:00 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:01:01.097933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:01.098768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:01.107983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.108933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.109853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.110837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.111511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.112181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.159347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:01.159972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:01.179874 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.180725 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.181320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.182840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.185947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.186684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.305886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:01.315293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0151ae10-7c80-49c7-ae77-8b38a4fe26f6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.221166 Sep 07 08:01:01.316571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 391/759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:01 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:01.321654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:01.322696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:01.344701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.345525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.346149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.347044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.347650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.348345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.537028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:01.552252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:01.553794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:01.554962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d45adcc7-f206-4760-acad-0d9170930ff8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.237189 Sep 07 08:01:01.555516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 392/760] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:01 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:01.648566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:01.656418 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c9312dc5-762a-4fe0-983c-9f275eb12939 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1523 microversion: 2.1 time: 0.501458 Sep 07 08:01:01.672546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 369/761] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:01 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1523 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:01.814959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:01.815847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:01.825570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.826737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.828607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.832856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6159ab2f-079b-4206-85c4-dd5099402edb req-b708457b-b7fb-4425-ac3d-4c1c2b91db96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee87953e-ba27-4c28-b0db-0dfa81b496e6", "name": "network-vif-deleted", "tag": "e3286f12-f5f4-4c6b-9125-ae90c9cdaefa"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:01.833804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.834790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.835281 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.845186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6159ab2f-079b-4206-85c4-dd5099402edb req-b708457b-b7fb-4425-ac3d-4c1c2b91db96 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:01.846358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6159ab2f-079b-4206-85c4-dd5099402edb req-b708457b-b7fb-4425-ac3d-4c1c2b91db96 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:01.847021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6159ab2f-079b-4206-85c4-dd5099402edb req-b708457b-b7fb-4425-ac3d-4c1c2b91db96 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:01.860592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6159ab2f-079b-4206-85c4-dd5099402edb req-b708457b-b7fb-4425-ac3d-4c1c2b91db96 service nova] Creating event network-vif-deleted:e3286f12-f5f4-4c6b-9125-ae90c9cdaefa for instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 on hv-cinder-83602 Sep 07 08:01:01.866348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:01.867782 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6159ab2f-079b-4206-85c4-dd5099402edb req-b708457b-b7fb-4425-ac3d-4c1c2b91db96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038864 Sep 07 08:01:01.869189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 370/762] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:01.873188 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:02.006393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:02.014719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b4bb8f21-ecbc-43be-b8e9-fb16c552805e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.210378 Sep 07 08:01:02.028579 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 393/763] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:01 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:02.337615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:02.343748 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:02.344779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:02.351751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:02.352618 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:02.353133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:02.353914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:02.354382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:02.354811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:02.504859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:02.512419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-227ea012-35bb-4388-948f-28e50dbbded0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.175801 Sep 07 08:01:02.513204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 371/764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:02 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:02.582113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:02.582783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:02.589421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:02.589913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:02.590358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:02.591063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:02.591536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:02.591968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:02.681819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:02.682668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:02.690628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:02.695569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:02.696669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:02.697980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:02.699582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:02.700293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:02.774937 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:02.785796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:02.787519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:02.788929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6223035-9d86-469e-9420-f7a2102f36a3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.211220 Sep 07 08:01:02.804357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:02.805089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 394/765] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:02 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:01:02.808197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22d58d42-cc14-4d95-869b-48ea6a40be1f tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1307 microversion: 2.1 time: 0.130860 Sep 07 08:01:02.809024 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 372/766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:02 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:01:03.038456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:03.039438 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:03.051570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.052186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.052800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.053826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.054441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.055045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.216814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:03.226053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-30ac892f-3cec-465b-93d5-49f19c0bc189 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.191403 Sep 07 08:01:03.226651 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 395/767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:03 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:03.538809 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:03.540116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:03.547055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.547864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.548329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.549034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.549487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.549947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.696906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:03.705848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-02eafc3c-c781-4cec-af3e-b63e409412cb tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.171867 Sep 07 08:01:03.706785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 373/768] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:03 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:03.816668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:03.817289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:03.823803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.824371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.825017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.825719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.826175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.826602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.832804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:03.833717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:03.843453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.844103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.844770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.845703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:03.846256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:03.846778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:03.922463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:03.930054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cf112a80-237e-46ae-b7f7-e81266530916 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1307 microversion: 2.1 time: 0.101518 Sep 07 08:01:03.944106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 374/769] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:03 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:03.982207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:03.991225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:03.992602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:03.994571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d84e350-cbe1-4274-8733-79ec9f7a2bc9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.182959 Sep 07 08:01:03.995130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 396/770] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:03 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:04.249793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:04.250728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:04.256840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:04.257396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:04.259039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:04.259039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:04.259039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:04.259624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:04.405531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:04.414109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3fda7373-b684-417b-9bde-e4166be48e7b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.168664 Sep 07 08:01:04.414676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 375/771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:04 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:04.729153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:04.729707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:04.737080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:04.737576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:04.738015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:04.738763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:04.739301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:04.739736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:04.745381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:04.907497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:04.918233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a373d5b-2064-496c-9a8c-abcc0e8e0c79 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.193067 Sep 07 08:01:04.919133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 397/772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:04 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:04.956850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:04.957575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:04.964711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:04.965474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:04.966114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:04.966979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:04.967961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:04.968807 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.010336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.010826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.011248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.011700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lazy-loading 'fault' on Instance uuid ee87953e-ba27-4c28-b0db-0dfa81b496e6 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:01:05.022135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:05.023026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:05.029769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.031484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.032137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.033243 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.049286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.051137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.086252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ececfc19b41b5b8387dc6908d4a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3d7139782f4b63ac6dc8d4618abe64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:05.100646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-724690a4-2f14-4bc5-9bae-94c9937114db tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 200 len: 1312 microversion: 2.1 time: 0.146384 Sep 07 08:01:05.122263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 376/773] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:04 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:05.305925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:05.329194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:05.333005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:05.339460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6df79f92-1bc9-44f2-9031-2dae425b60d5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.321515 Sep 07 08:01:05.341873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 398/774] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:05 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:01:05.437842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:05.444641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:05.452730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.453168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.453604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.454310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.454763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.455189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.627095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:05.634920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a2099e86-8a45-4611-af2c-d158e3ea4ad3 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1569 microversion: 2.1 time: 0.201656 Sep 07 08:01:05.635692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 377/775] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:05 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:05.659018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:05.660015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:05.667434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.667932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.668419 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.669110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.669567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.669998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.717076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120494) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 08:01:05.800392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-301914c3-6821-4e0d-b086-6ca529f6d505 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "POST /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb/action" status: 202 len: 0 microversion: 2.1 time: 0.146601 Sep 07 08:01:05.803787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 399/776] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 7 08:01:05 2022] POST /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:01:05.816790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:05.819249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:05.833264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.833987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.835207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.836832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.838070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.840826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.944769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:05.945391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:05.962075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.972624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.974086 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:05.976461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:05.977235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:05.982624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:06.034527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:06.060861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0d2f6174-174c-466f-bfd5-6bdd88ec74e5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1577 microversion: 2.1 time: 0.255383 Sep 07 08:01:06.084620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 378/777] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:05 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:06.131566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:06.132271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] [instance: ee87953e-ba27-4c28-b0db-0dfa81b496e6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:06.142981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:06.146878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:06.147051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:06.147492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:06.150284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:06.150836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:06.151283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:06.153825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b59e3f3-e69c-4f0c-a4d7-477df96f2b84 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.214621 Sep 07 08:01:06.155493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 400/778] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:05 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:06.170048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:06.173319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] HTTP exception thrown: Instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 could not be found. Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Request method failure captured: Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 HTTP/1.1 Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5sTGRLiOMZ9BztMknjwb1bTtmawAr05yKxmMY6XSOU-KGdsmV2iVQKqW9_UUIk6hFZCmT4z6YqxgGZt599G6X9iaYWqSu0TMD3sA6Re6ROAEQYf9ZHymvf2WTN82nDB54vuXv7oje7dmNjBVjSQD6pA5gfJ7cozNzZVvgrcxmLLHk Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:01:06.175463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4d3d7139782f4b63ac6dc8d4618abe64", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4d3d7139782f4b63ac6dc8d4618abe64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 4d3d7139782f4b63ac6dc8d4618abe64 Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-31683529 Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: b52ececfc19b41b5b8387dc6908d4a4a Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-ServerRescueNegativeTestJSON-31683529-project Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 could not be found. Sep 07 08:01:06.176777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': 'ee87953e-ba27-4c28-b0db-0dfa81b496e6'} Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 could not be found. Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:06.177492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 could not be found. Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 could not be found. Sep 07 08:01:06.178984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:06.180312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] Returning 404 to user: Instance ee87953e-ba27-4c28-b0db-0dfa81b496e6 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:06.180312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8b466aa5-d6af-47c4-81a7-b6ac921365c6 tempest-ServerRescueNegativeTestJSON-31683529 tempest-ServerRescueNegativeTestJSON-31683529-project] 10.222.0.26 "GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6" status: 404 len: 111 microversion: 2.1 time: 0.049841 Sep 07 08:01:06.180312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 379/779] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:06 2022] GET /compute/v2.1/servers/ee87953e-ba27-4c28-b0db-0dfa81b496e6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 08:01:06.371163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:06.372036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:06.391603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:06.392345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:06.393001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:06.393866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:06.394478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:06.395065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:06.671825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:06.683908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:06.685677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:06.687077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b3680cf-5467-42b7-80ee-a895e6681a46 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.320483 Sep 07 08:01:06.688418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 401/780] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:06 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:07.088957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:07.089798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:07.102798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:07.126506 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:07.128837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:07.129692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:07.131930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:07.133477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:07.134976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:07.177965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:07.178575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:07.185808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:07.193664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:07.195253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:07.207439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:07.207940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:07.208461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:07.433362 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:07.446553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2eb79470-1625-485b-bbea-afe77daf8899 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1519 microversion: 2.1 time: 0.362862 Sep 07 08:01:07.449144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 380/781] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:07 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1519 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:07.556047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-46cabcae-74d9-4e6d-afc0-a12e6524e1af req-654315fd-394e-4815-91ee-0f78ca31df38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ac8466-b0bf-4936-a910-9ac7e096614e", "name": "network-vif-plugged", "status": "completed", "tag": "dc6d946d-0223-4317-bea3-d7cb4c7d36d3"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:07.570317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-46cabcae-74d9-4e6d-afc0-a12e6524e1af req-654315fd-394e-4815-91ee-0f78ca31df38 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:07.571037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-46cabcae-74d9-4e6d-afc0-a12e6524e1af req-654315fd-394e-4815-91ee-0f78ca31df38 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:07.572020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-46cabcae-74d9-4e6d-afc0-a12e6524e1af req-654315fd-394e-4815-91ee-0f78ca31df38 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:07.588703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-46cabcae-74d9-4e6d-afc0-a12e6524e1af req-654315fd-394e-4815-91ee-0f78ca31df38 service nova] Creating event network-vif-plugged:dc6d946d-0223-4317-bea3-d7cb4c7d36d3 for instance 07ac8466-b0bf-4936-a910-9ac7e096614e on hv-cinder-83602 Sep 07 08:01:07.595395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-46cabcae-74d9-4e6d-afc0-a12e6524e1af req-654315fd-394e-4815-91ee-0f78ca31df38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143980 Sep 07 08:01:07.595988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 381/782] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:07.725058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:07.727170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:07.745986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:07.748671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:07.749411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:07.752502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:07.756364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:07.757717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:07.778031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:07.786713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6f81a8a-fe11-44b7-8d75-50121f1e08ec tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.612525 Sep 07 08:01:07.793109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 402/783] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:07 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:08.116719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:08.125449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:08.126887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:08.128056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-221f54ce-3949-45d2-a790-85c7d5c5c9cb tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.418730 Sep 07 08:01:08.144120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 382/784] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:07 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:01:08.476841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:08.478080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:08.485242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:08.485953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:08.486546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:08.487404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:08.488004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:08.488608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:08.745175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:08.760693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61108749-b885-4d76-a9a8-b41de390bbd9 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.288130 Sep 07 08:01:08.768288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 403/785] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:08 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:08.824422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:08.825030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:08.838770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:08.839170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:08.840873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:08.840873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:08.840873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:08.841257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:09.107163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:09.119797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9780d64e-fa81-4679-91ee-a10c55f92e40 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1362 microversion: 2.1 time: 0.301045 Sep 07 08:01:09.141069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 383/786] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:08 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:09.162646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:09.163522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:09.171388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:09.172478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:09.174241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:09.175412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:09.176347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:09.177066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:09.388330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:09.412996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:09.414962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:09.416557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-887248a8-39df-44ba-957d-cc70e4c5aec1 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.258787 Sep 07 08:01:09.417648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 404/787] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:09 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:01:09.613641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-ab096af3-fbef-4cf5-b6f0-3c3cd8a549ee req-4ab60346-5408-4d13-97c2-ed6b608bccae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a500c169-e521-4f76-b825-f3c52a0583fb", "name": "network-vif-unplugged", "status": "completed", "tag": "ccdaaab5-715d-42e0-bff3-ea1b67a8f356"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:09.628459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ab096af3-fbef-4cf5-b6f0-3c3cd8a549ee req-4ab60346-5408-4d13-97c2-ed6b608bccae service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:09.630968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ab096af3-fbef-4cf5-b6f0-3c3cd8a549ee req-4ab60346-5408-4d13-97c2-ed6b608bccae service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:09.631501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-ab096af3-fbef-4cf5-b6f0-3c3cd8a549ee req-4ab60346-5408-4d13-97c2-ed6b608bccae service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:09.645397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-ab096af3-fbef-4cf5-b6f0-3c3cd8a549ee req-4ab60346-5408-4d13-97c2-ed6b608bccae service nova] Creating event network-vif-unplugged:ccdaaab5-715d-42e0-bff3-ea1b67a8f356 for instance a500c169-e521-4f76-b825-f3c52a0583fb on hv-cinder-83602 Sep 07 08:01:09.650856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-ab096af3-fbef-4cf5-b6f0-3c3cd8a549ee req-4ab60346-5408-4d13-97c2-ed6b608bccae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040819 Sep 07 08:01:09.651576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 384/788] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:09.794691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:09.795312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:09.805334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:09.806076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:09.806766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:09.807707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:09.808420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:09.809061 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:10.045816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:10.055594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5cdb39eb-8435-4ef1-9276-58a2ce39dd44 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.264649 Sep 07 08:01:10.056317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 405/789] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:09 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:10.145916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:10.147701 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:10.166417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:10.168617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:10.172409 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:10.173402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:10.174309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:10.174914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:10.448573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:10.451027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:10.467996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:10.474409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:10.475112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:10.475873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:10.476438 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:10.476867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:10.700797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:10.709869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e9025294-d526-4f27-8198-aa179b0eed95 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1549 microversion: 2.1 time: 0.569632 Sep 07 08:01:10.718808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 385/790] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:10 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1549 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:10.763918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:10.765283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:10.780028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:10.783344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:10.784237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:10.788478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:10.788978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:10.789414 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:10.820339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:10.830598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:10.838317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:10.839827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5fcc03a6-83b8-4ea2-a94e-618dff1bec54 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.399011 Sep 07 08:01:10.842684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 406/791] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:10 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:10.908070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b800986c-c620-498b-beaf-6823aa4de787 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153072 Sep 07 08:01:10.910239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 386/792] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 7 08:01:10 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:11.081186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:11.082918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:11.102828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:11.105090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:11.107874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:11.108857 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:11.109522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:11.111583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:11.514189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:11.524394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b2a50f72-1c50-4604-b830-c1213a6748ec tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.448957 Sep 07 08:01:11.525297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 407/793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:11 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:11.866584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:11.867194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:11.873155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:11.874280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:11.876723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:11.877900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:11.878521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:11.879121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:12.057916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:12.068557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:12.070255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:12.071517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7092427c-7b42-41e6-b322-c84ebed04bdc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1740 microversion: 2.20 time: 0.209351 Sep 07 08:01:12.072599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 387/794] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:11 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:12.549372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:12.550119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:12.556856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:12.557346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:12.557784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:12.558482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:12.558938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:12.559362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:12.764295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:12.787076 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-baf491f5-1de8-4efb-91b7-cfcaf7b750e7 req-07dd0834-6602-496a-92f1-55e4f6a6fb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ac8466-b0bf-4936-a910-9ac7e096614e", "tag": "dc6d946d-0223-4317-bea3-d7cb4c7d36d3"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:12.792414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66f89ef7-4242-4c3c-b310-4d7ba617d858 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.234212 Sep 07 08:01:12.793490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 408/795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:12 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:01:12.821876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-baf491f5-1de8-4efb-91b7-cfcaf7b750e7 req-07dd0834-6602-496a-92f1-55e4f6a6fb9b service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:12.822637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-baf491f5-1de8-4efb-91b7-cfcaf7b750e7 req-07dd0834-6602-496a-92f1-55e4f6a6fb9b service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:12.823261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-baf491f5-1de8-4efb-91b7-cfcaf7b750e7 req-07dd0834-6602-496a-92f1-55e4f6a6fb9b service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:12.835969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-baf491f5-1de8-4efb-91b7-cfcaf7b750e7 req-07dd0834-6602-496a-92f1-55e4f6a6fb9b service nova] Creating event network-changed:dc6d946d-0223-4317-bea3-d7cb4c7d36d3 for instance 07ac8466-b0bf-4936-a910-9ac7e096614e on hv-cinder-83602 Sep 07 08:01:12.844516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-baf491f5-1de8-4efb-91b7-cfcaf7b750e7 req-07dd0834-6602-496a-92f1-55e4f6a6fb9b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061472 Sep 07 08:01:12.845723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 388/796] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:01:13.103436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:13.104235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:13.112454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:13.113433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:13.114192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:13.115146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:13.116019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:13.116641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:13.267994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-826208d4-fe93-4549-a646-aaf54d90be31 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Action: 'create', calling method: .version_select at 0x7f831eb8eaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-643903122"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:13.291411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:13.299975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:13.301665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:13.303753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e47834b1-d9b0-4110-be37-004fa16fcbbc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1722 microversion: 2.20 time: 0.210083 Sep 07 08:01:13.304960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 409/797] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:13 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:13.628841 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-826208d4-fe93-4549-a646-aaf54d90be31 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.524235 Sep 07 08:01:13.630036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 389/798] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Sep 7 08:01:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 526 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 07 08:01:13.643636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3f37a37-b50e-4e7c-bd41-70e5604bba6a tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e80aaf0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:13.712866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3f37a37-b50e-4e7c-bd41-70e5604bba6a tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f" status: 200 len: 344 microversion: 2.1 time: 0.073767 Sep 07 08:01:13.714221 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 410/799] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 08:01:13 2022] GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:13.822814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:13.823684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:13.831062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:13.831640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:13.832260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:13.833226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:13.833758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:13.834260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:13.990827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:13.999929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b463fb36-b904-4a37-994c-cd20021a4326 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.180872 Sep 07 08:01:14.000545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 390/800] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:13 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:14.331027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:14.331638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:14.338136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:14.338619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:14.339049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:14.339738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:14.340226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:14.340653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:14.622804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:14.631851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:14.633342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:14.634492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c30da50-60f8-4ae3-b013-1b269b146e19 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1722 microversion: 2.20 time: 0.308264 Sep 07 08:01:14.635046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 411/801] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:14 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:14.728583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-58cc4175-0b3e-4cdc-a898-670eeb8e8243 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e9b6f70>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:14.776800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-58cc4175-0b3e-4cdc-a898-670eeb8e8243 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f" status: 200 len: 345 microversion: 2.1 time: 0.051988 Sep 07 08:01:14.777366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 391/802] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 08:01:14 2022] GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:14.790440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2f8e2cb-c3ea-419f-b549-98361cdf2aab tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Action: 'create', calling method: .version_select at 0x7f831e7d63a0>, body: {"snapshot": {"volume_id": "721a7171-45bc-4b20-801a-2bd11f22619f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-404432150"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:14.934526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2f8e2cb-c3ea-419f-b549-98361cdf2aab tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.147823 Sep 07 08:01:14.935189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 412/803] 10.222.0.26 () {60 vars in 1162 bytes} [Wed Sep 7 08:01:14 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:14.947477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f64ac0c8-0ecc-498f-8d13-5dacb4da8041 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e9ed040>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:14.978092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f64ac0c8-0ecc-498f-8d13-5dacb4da8041 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 200 len: 286 microversion: 2.1 time: 0.034332 Sep 07 08:01:14.986619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 392/804] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:01:14 2022] GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:14.991914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b490c136-4b79-4574-9426-bd90001e6188 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831ea0f670>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:15.022804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b490c136-4b79-4574-9426-bd90001e6188 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034806 Sep 07 08:01:15.023371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 413/805] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Sep 7 08:01:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:15.033467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:15.034074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:15.035136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ef2c41e5-41dd-48ba-b5ac-c5a6abed2ef2 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e961820>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:15.040757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:15.041237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:15.043286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:15.044038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:15.044600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:15.045032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:15.065956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ef2c41e5-41dd-48ba-b5ac-c5a6abed2ef2 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 200 len: 286 microversion: 2.1 time: 0.034412 Sep 07 08:01:15.066703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 414/806] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:01:15 2022] GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:01:15.183499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:15.191596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e86e4bc0-f9bd-43a7-a926-6619560385d0 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.162716 Sep 07 08:01:15.192173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 393/807] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:15 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:15.661599 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:15.662114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:15.668200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:15.668691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:15.669127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:15.669819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:15.670327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:15.670753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:15.808024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:15.816951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:15.818393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:15.819539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57e627de-762c-4dc0-8f37-78e6801ce77e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1722 microversion: 2.20 time: 0.162080 Sep 07 08:01:15.820198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 415/808] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:15 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:16.078993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a70923ea-14e4-41d2-9194-671816beb805 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e9c8430>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:16.115541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a70923ea-14e4-41d2-9194-671816beb805 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 200 len: 286 microversion: 2.1 time: 0.040556 Sep 07 08:01:16.116232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 394/809] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:01:16 2022] GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:16.214866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:16.215555 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:16.222893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:16.223383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:16.223881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:16.224612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:16.225070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:16.225493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:16.369200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:16.372702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:16.378019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9a9dbe2-a0a9-4dd2-8634-af2f2f1066cd tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.167045 Sep 07 08:01:16.378589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 416/810] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:16 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:16.845333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:16.845939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:16.851837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:16.852348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:16.852781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:16.853460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:16.853909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:16.854328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:16.989588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:16.997629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:16.999962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:17.001154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8489e1e6-7795-4fc7-a3d8-3ec1bda0ce09 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1722 microversion: 2.20 time: 0.159798 Sep 07 08:01:17.001695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 395/811] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:16 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:17.130080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-013d0741-7383-4be4-8831-32a13befb533 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e7d68b0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:17.159517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-013d0741-7383-4be4-8831-32a13befb533 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 200 len: 286 microversion: 2.1 time: 0.034073 Sep 07 08:01:17.160074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 417/812] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:01:17 2022] GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:01:17.402390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:17.403025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:17.410431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:17.410911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:17.411345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:17.412031 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:17.412538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:17.412959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:17.544916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:17.553396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3394eb64-9003-4381-8225-e635c14b4278 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.154892 Sep 07 08:01:17.553961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 396/813] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:17 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:17.973869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d160de0e-d7ec-41e6-9752-4b1ca1bb68ec req-cc914b0e-18fb-4bfd-aef7-ea8ae7cfacf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b921f49-ab37-4207-8301-4d822f5cebaf", "name": "network-vif-unplugged", "status": "completed", "tag": "e8074f9b-36f4-44cb-a791-0408a89aa4d8"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:17.985374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d160de0e-d7ec-41e6-9752-4b1ca1bb68ec req-cc914b0e-18fb-4bfd-aef7-ea8ae7cfacf2 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:17.985859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d160de0e-d7ec-41e6-9752-4b1ca1bb68ec req-cc914b0e-18fb-4bfd-aef7-ea8ae7cfacf2 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:17.986290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d160de0e-d7ec-41e6-9752-4b1ca1bb68ec req-cc914b0e-18fb-4bfd-aef7-ea8ae7cfacf2 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:17.996919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d160de0e-d7ec-41e6-9752-4b1ca1bb68ec req-cc914b0e-18fb-4bfd-aef7-ea8ae7cfacf2 service nova] Creating event network-vif-unplugged:e8074f9b-36f4-44cb-a791-0408a89aa4d8 for instance 5b921f49-ab37-4207-8301-4d822f5cebaf on hv-cinder-83602 Sep 07 08:01:18.002009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d160de0e-d7ec-41e6-9752-4b1ca1bb68ec req-cc914b0e-18fb-4bfd-aef7-ea8ae7cfacf2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032121 Sep 07 08:01:18.002588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 418/814] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:18.026283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:18.026945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:18.033881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:18.034361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:18.034819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:18.035531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:18.035981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:18.036427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:18.172720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7f6ef1be-52ef-4cd4-94f1-0ca5bb92275b tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e80aca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:18.209890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7f6ef1be-52ef-4cd4-94f1-0ca5bb92275b tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 200 len: 287 microversion: 2.1 time: 0.041322 Sep 07 08:01:18.210447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 419/815] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:01:18 2022] GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:01:18.221361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b561424-3bd5-4820-ab90-17af1becbcb0 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e7d6f70>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:18.227149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:18.235737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:18.237237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:18.238379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e482703a-986d-4dcc-95dc-b811bc6ac924 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1722 microversion: 2.20 time: 0.216089 Sep 07 08:01:18.238934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 397/816] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:18 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:18.296703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b561424-3bd5-4820-ab90-17af1becbcb0 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 202 len: 0 microversion: 2.1 time: 0.079067 Sep 07 08:01:18.297286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 420/817] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Sep 7 08:01:18 2022] DELETE /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 08:01:18.305357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6e20bc50-831e-4d74-9c9b-371e144feb53 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831ea0fee0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:18.334974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6e20bc50-831e-4d74-9c9b-371e144feb53 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 200 len: 286 microversion: 2.1 time: 0.033345 Sep 07 08:01:18.335521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 398/818] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:01:18 2022] GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:18.575915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:18.577469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:18.584023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:18.584546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:18.584989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:18.585686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:18.586149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:18.586577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:18.723474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:18.731329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27f484b1-d3a6-4ec6-8ca5-5239ccc7a4da tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.159412 Sep 07 08:01:18.731896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 421/819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:18 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:19.265676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:19.266199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:19.272293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.273022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.273646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.274667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.275268 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.275839 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.347566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-159b20bb-850b-42c3-85c2-ddc909166905 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e80ab80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:19.372821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-159b20bb-850b-42c3-85c2-ddc909166905 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] HTTP exception thrown: Snapshot 14422aee-d724-40e6-bdfc-a1bc60b99a8a could not be found. Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-159b20bb-850b-42c3-85c2-ddc909166905 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Request method failure captured: Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a HTTP/1.1 Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE_JdX_LW17RtfAOJuUqGLqfhgV-KgNcOMOEsXeNNxalUrMlgQV3GIzebBA4xSkVfEjQThvS5_0KI2Rfw0TlF7sA2RsJ_0DWo9EBrEWtoLurlaUOlgHT4SLYIU9a5qd1J5t28-c-iYn9dh2FkTnzRENAudJI0rkl-8ddFWl6L1sxxsQ Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:01:19.375272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d30a51f45f6a4147a505a7f0a3414e5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: c78abc908f1f41c28940f5fe1ce656c2 Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Snapshot 14422aee-d724-40e6-bdfc-a1bc60b99a8a could not be found. Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '14422aee-d724-40e6-bdfc-a1bc60b99a8a'} Sep 07 08:01:19.376870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 14422aee-d724-40e6-bdfc-a1bc60b99a8a could not be found. (HTTP 404) (Request-ID: req-0b82d026-da8f-4f32-a299-d75225eee3a1) Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:19.377902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 08:01:19.379019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 14422aee-d724-40e6-bdfc-a1bc60b99a8a could not be found. Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 08:01:19.380278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 14422aee-d724-40e6-bdfc-a1bc60b99a8a could not be found. Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 14422aee-d724-40e6-bdfc-a1bc60b99a8a could not be found. Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-159b20bb-850b-42c3-85c2-ddc909166905 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Returning 404 to user: Snapshot 14422aee-d724-40e6-bdfc-a1bc60b99a8a could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-159b20bb-850b-42c3-85c2-ddc909166905 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a" status: 404 len: 111 microversion: 2.1 time: 0.033896 Sep 07 08:01:19.382068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 422/820] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:01:19 2022] GET /compute/v2.1/os-snapshots/14422aee-d724-40e6-bdfc-a1bc60b99a8a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:19.386986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ade82e96-125c-4bad-ad52-f27efd5cc889 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e961160>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:19.422494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:19.430545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:19.432346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:19.433728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-972916fd-79f9-4aea-bd5e-554a3e539ab3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1725 microversion: 2.20 time: 0.173233 Sep 07 08:01:19.434309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 399/821] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:19 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:19.459333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df939984-2fca-4dba-a553-a2dd1f452e5a"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:19.459493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ade82e96-125c-4bad-ad52-f27efd5cc889 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f" status: 202 len: 0 microversion: 2.1 time: 0.077051 Sep 07 08:01:19.460035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 423/822] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 08:01:19 2022] DELETE /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 08:01:19.461787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:19.468490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.468644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be8cbefc-4fbd-40af-bde1-0def23c363af tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e918430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:19.468969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.469428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.470118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.470565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.470983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.518580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be8cbefc-4fbd-40af-bde1-0def23c363af tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f" status: 200 len: 344 microversion: 2.1 time: 0.054316 Sep 07 08:01:19.519401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 424/823] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 08:01:19 2022] GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:01:19.754456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:19.755092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:19.761300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.761790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.762327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.763021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.763447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.764728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.770119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-be6d38d0-aed2-49f5-a26f-875a12a8d716 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314817 Sep 07 08:01:19.770671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 400/824] 10.222.0.26 () {62 vars in 1364 bytes} [Wed Sep 7 08:01:19 2022] POST /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 08:01:19.926902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:19.934674 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:19.935162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:19.935569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23641a16-eec0-482e-be78-bbc4d1ed577a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.184803 Sep 07 08:01:19.936751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 425/825] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:19 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:19.942578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.943066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.943502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.944216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:19.944674 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:19.945112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:19.949104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:20.194491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0c5a2609-28ef-4ed0-9d3d-f1039c54ce83 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-volume_attachments/df939984-2fca-4dba-a553-a2dd1f452e5a" status: 202 len: 0 microversion: 2.20 time: 0.263656 Sep 07 08:01:20.195089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 401/826] 10.222.0.26 () {60 vars in 1457 bytes} [Wed Sep 7 08:01:19 2022] DELETE /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-volume_attachments/df939984-2fca-4dba-a553-a2dd1f452e5a => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 08:01:20.256065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:20.256679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:20.262625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:20.263103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:20.263527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:20.264522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:20.264980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:20.265404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:20.298133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120494) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 08:01:20.364541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44def669-c0ca-46f5-8cc3-66a4830ad739 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "POST /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/action" status: 202 len: 0 microversion: 2.20 time: 0.112390 Sep 07 08:01:20.365165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 426/827] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Sep 7 08:01:20 2022] POST /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:01:20.373528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:20.374290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:20.380745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:20.381243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:20.381682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:20.382381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:20.383515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:20.383963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:20.519492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:20.527860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:20.530074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:20.531864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-db834441-ee8d-4782-8b4e-88e2b4b3337c tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1673 microversion: 2.20 time: 0.162224 Sep 07 08:01:20.533130 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 402/828] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:20 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:20.543914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4063069-7310-4a04-8c65-8d508a36e360 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831ea0f430>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:20.566567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a4063069-7310-4a04-8c65-8d508a36e360 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] HTTP exception thrown: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4063069-7310-4a04-8c65-8d508a36e360 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Request method failure captured: Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f HTTP/1.1 Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE_JdX_LW17RtfAOJuUqGLqfhgV-KgNcOMOEsXeNNxalUrMlgQV3GIzebBA4xSkVfEjQThvS5_0KI2Rfw0TlF7sA2RsJ_0DWo9EBrEWtoLurlaUOlgHT4SLYIU9a5qd1J5t28-c-iYn9dh2FkTnzRENAudJI0rkl-8ddFWl6L1sxxsQ Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:01:20.568709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d30a51f45f6a4147a505a7f0a3414e5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: c78abc908f1f41c28940f5fe1ce656c2 Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '721a7171-45bc-4b20-801a-2bd11f22619f'} Sep 07 08:01:20.570235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. (HTTP 404) (Request-ID: req-728d4027-7dcb-4b2d-80b8-977a22cc657b) Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.571170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 08:01:20.572524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 08:01:20.573665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a4063069-7310-4a04-8c65-8d508a36e360 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Returning 404 to user: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:20.574789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a4063069-7310-4a04-8c65-8d508a36e360 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f" status: 404 len: 109 microversion: 2.1 time: 0.040745 Sep 07 08:01:20.577303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 427/829] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 08:01:20 2022] GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 08:01:20.584429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-87d881b9-3464-4fb8-91fd-3c4855f79718 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e9b64c0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:20.617146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-87d881b9-3464-4fb8-91fd-3c4855f79718 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] HTTP exception thrown: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-87d881b9-3464-4fb8-91fd-3c4855f79718 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Request method failure captured: Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f HTTP/1.1 Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE_JdX_LW17RtfAOJuUqGLqfhgV-KgNcOMOEsXeNNxalUrMlgQV3GIzebBA4xSkVfEjQThvS5_0KI2Rfw0TlF7sA2RsJ_0DWo9EBrEWtoLurlaUOlgHT4SLYIU9a5qd1J5t28-c-iYn9dh2FkTnzRENAudJI0rkl-8ddFWl6L1sxxsQ Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:01:20.619705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d30a51f45f6a4147a505a7f0a3414e5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: c78abc908f1f41c28940f5fe1ce656c2 Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '721a7171-45bc-4b20-801a-2bd11f22619f'} Sep 07 08:01:20.621511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. (HTTP 404) (Request-ID: req-8a5e74f2-85f8-4222-b94c-db91f3d7f9f6) Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.622300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 08:01:20.623465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 08:01:20.624627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-87d881b9-3464-4fb8-91fd-3c4855f79718 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Returning 404 to user: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-87d881b9-3464-4fb8-91fd-3c4855f79718 tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f" status: 404 len: 109 microversion: 2.1 time: 0.040873 Sep 07 08:01:20.626070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 403/830] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 08:01:20 2022] DELETE /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:20.633250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12b7abe4-a7cb-4e73-806a-941962c45f8e tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Calling method '.version_select at 0x7f831e86ab80>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:20.662057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-12b7abe4-a7cb-4e73-806a-941962c45f8e tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] HTTP exception thrown: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12b7abe4-a7cb-4e73-806a-941962c45f8e tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Request method failure captured: Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f HTTP/1.1 Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE_JdX_LW17RtfAOJuUqGLqfhgV-KgNcOMOEsXeNNxalUrMlgQV3GIzebBA4xSkVfEjQThvS5_0KI2Rfw0TlF7sA2RsJ_0DWo9EBrEWtoLurlaUOlgHT4SLYIU9a5qd1J5t28-c-iYn9dh2FkTnzRENAudJI0rkl-8ddFWl6L1sxxsQ Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:01:20.664197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d30a51f45f6a4147a505a7f0a3414e5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d30a51f45f6a4147a505a7f0a3414e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: d30a51f45f6a4147a505a7f0a3414e5c Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-206846705 Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: c78abc908f1f41c28940f5fe1ce656c2 Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesSnapshotsTestJSON-206846705-project Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '721a7171-45bc-4b20-801a-2bd11f22619f'} Sep 07 08:01:20.665745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. (HTTP 404) (Request-ID: req-feac50e3-8bf3-44cb-8788-5c2a748b712e) Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.666682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 08:01:20.668241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 08:01:20.670604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12b7abe4-a7cb-4e73-806a-941962c45f8e tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] Returning 404 to user: Volume 721a7171-45bc-4b20-801a-2bd11f22619f could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12b7abe4-a7cb-4e73-806a-941962c45f8e tempest-VolumesSnapshotsTestJSON-206846705 tempest-VolumesSnapshotsTestJSON-206846705-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f" status: 404 len: 109 microversion: 2.1 time: 0.037322 Sep 07 08:01:20.672067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 428/831] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 7 08:01:20 2022] GET /compute/v2.1/os-volumes/721a7171-45bc-4b20-801a-2bd11f22619f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:20.959864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:20.960497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:20.968488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:20.969108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:20.969551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:20.970256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:20.970714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:20.971144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:21.179640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:21.198524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bb5efcd7-0a93-4328-84a0-ae236746aafb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.242578 Sep 07 08:01:21.214880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 404/832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:20 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:21.560060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:21.561270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:21.568941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:21.569425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:21.569856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:21.570551 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:21.571004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:21.571423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:21.725115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:21.735059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:21.736787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:21.738740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98cd2ef9-b570-4de0-bd3c-6f2071cdb3e5 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1673 microversion: 2.20 time: 0.183007 Sep 07 08:01:21.739820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 429/833] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:21 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:22.222167 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:22.222898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:22.229358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:22.229846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:22.230474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:22.231173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:22.231637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:22.232066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:22.409297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:22.417315 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e10a8dbd-0d2e-42c9-9487-544e59e1e3a6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.198904 Sep 07 08:01:22.417884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 405/834] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:22 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:22.766185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:22.766799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:22.773491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:22.773979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:22.774420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:22.775115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:22.775568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:22.775991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:22.918726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:22.927414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:22.929570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:22.931173 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d993f2ae-16e9-4259-a25e-acc02d4af140 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.169100 Sep 07 08:01:22.931745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 430/835] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:22 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:23.288394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-c644e2a9-b0a7-49ff-9ac1-9c4c19bb94c8 req-003f89fc-058f-4599-9dac-3aaf444a4c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a500c169-e521-4f76-b825-f3c52a0583fb", "name": "network-vif-plugged", "status": "completed", "tag": "ccdaaab5-715d-42e0-bff3-ea1b67a8f356"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:23.302119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-c644e2a9-b0a7-49ff-9ac1-9c4c19bb94c8 req-003f89fc-058f-4599-9dac-3aaf444a4c8f service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:23.303567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-c644e2a9-b0a7-49ff-9ac1-9c4c19bb94c8 req-003f89fc-058f-4599-9dac-3aaf444a4c8f service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:23.304002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-c644e2a9-b0a7-49ff-9ac1-9c4c19bb94c8 req-003f89fc-058f-4599-9dac-3aaf444a4c8f service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:23.318403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-c644e2a9-b0a7-49ff-9ac1-9c4c19bb94c8 req-003f89fc-058f-4599-9dac-3aaf444a4c8f service nova] Creating event network-vif-plugged:ccdaaab5-715d-42e0-bff3-ea1b67a8f356 for instance a500c169-e521-4f76-b825-f3c52a0583fb on hv-cinder-83602 Sep 07 08:01:23.323541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-c644e2a9-b0a7-49ff-9ac1-9c4c19bb94c8 req-003f89fc-058f-4599-9dac-3aaf444a4c8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Sep 07 08:01:23.324434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 406/836] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:23.447509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:23.448165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:23.455121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:23.455680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:23.456288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:23.457070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:23.457644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:23.458029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:23.636675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:23.648869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c1a07f0-c1ab-460a-94f1-2cd13e44e06d tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.211684 Sep 07 08:01:23.649780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 431/837] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:23 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:23.958351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:23.959041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:23.965237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:23.965715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:23.966140 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:23.967419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:23.967877 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:23.968385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:24.119952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:24.129735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:24.131223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:24.132402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83ff0d7e-928c-4aea-8744-b079da4263bc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.178517 Sep 07 08:01:24.133027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 407/838] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:23 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:24.673584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:24.674211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:24.680968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:24.681459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:24.681899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:24.682921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:24.683189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:24.683617 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:24.830634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:24.838773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e39610f-a169-4a47-9b07-45190659b931 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.169565 Sep 07 08:01:24.839436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 432/839] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:24 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:25.161103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:25.161684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:25.168142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:25.168628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:25.169064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:25.170563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:25.171510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:25.171928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:25.309420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:25.318134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:25.319583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:25.320787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-efc2dead-5e98-4974-b572-6470e5674f55 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.163574 Sep 07 08:01:25.321344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 408/840] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:25 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:25.862916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:25.863722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:25.870630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:25.871118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:25.871626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:25.872361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:25.873318 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:25.873765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:26.021416 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:26.029522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca7e4c2c-7f93-476c-985c-653f982a0895 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.170434 Sep 07 08:01:26.030101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 433/841] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:25 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:26.347108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:26.347714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:26.355471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:26.356105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:26.356574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:26.358276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:26.358918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:26.359345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:26.499134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:26.507503 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:26.509076 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:26.510636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-548e4238-e61c-4502-8e75-dc494f085a40 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.167633 Sep 07 08:01:26.511474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 409/842] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:26 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:27.052852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:27.054150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:27.062393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:27.063394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:27.063832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:27.064730 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:27.065198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:27.065627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:27.203855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:27.212163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6cc8314e-febd-4dd9-bf94-f5af228bf2ce tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.163276 Sep 07 08:01:27.212742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 434/843] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:27 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:27.538170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:27.538964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:27.546785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:27.547388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:27.551040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:27.551847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:27.552420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:27.552977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:27.694563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:27.703160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:27.704713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:27.705886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-19c37dfb-ac2d-436e-bbbe-b4f4a1874476 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.171917 Sep 07 08:01:27.706440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 410/844] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:27 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:28.234791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:28.235462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:28.238011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:28.243876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:28.244410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:28.244852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:28.245561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:28.246024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:28.246454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:28.392386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:28.400262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26ce4d02-0b4c-4fed-be34-f227e9f3aeeb tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.169297 Sep 07 08:01:28.401021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 435/845] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:28 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:28.731476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:28.732879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:28.741008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:28.741901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:28.742879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:28.743995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:28.744749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:28.745427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:28.963950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:28.973584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:28.975628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:28.977387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-49c8f1df-e64d-4b25-b2db-55d953a6a16a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.250168 Sep 07 08:01:28.978004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 411/846] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:28 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:29.424981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:29.425690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:29.432658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:29.433171 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:29.433615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:29.434525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:29.434997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:29.436369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:29.584026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:29.595880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8531bc9e-5035-4e6d-9281-87fa011650f6 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.176718 Sep 07 08:01:29.596669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 436/847] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:29 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:30.012784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:30.013415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:30.020125 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:30.020608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:30.021039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:30.021727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:30.022177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:30.022595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:30.071145 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:30.071645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:30.077654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:30.078136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:30.078626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:30.079315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:30.079763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:30.080225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:30.103458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f709fa18-8eb7-49ae-a3ac-f7bf50ed4faf tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/ips" status: 200 len: 148 microversion: 2.1 time: 0.036897 Sep 07 08:01:30.104030 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 437/848] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 08:01:30 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:01:30.158493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:30.166653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:30.168370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:30.169579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a7350b77-c2ea-4a5e-b759-79861109cf9b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.160604 Sep 07 08:01:30.170623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 412/849] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:30 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:30.618767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:30.619376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:30.627096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:30.627735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:30.628294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:30.629062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:30.629587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:30.630079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:30.774700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:30.783080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5269a5bc-af2b-4cf7-8e1d-609e87547c45 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.168246 Sep 07 08:01:30.783634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 438/850] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:30 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:31.194710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:31.195344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:31.202373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:31.202856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:31.203286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:31.203970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:31.204447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:31.204948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:31.343727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:31.352642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:31.354301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:31.355672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bce79f29-c18e-48ae-9faa-a51b19c3e175 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.164852 Sep 07 08:01:31.356258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 413/851] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:31 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:31.806289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:31.807139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:31.814855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:31.815353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:31.815798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:31.816715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:31.817202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:31.817640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:31.965043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:31.973174 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-faa1b068-09a5-4b77-9f72-149517f8ff4b tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.170874 Sep 07 08:01:31.973835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 439/852] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:31 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:32.381857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:32.383196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:32.390577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:32.391168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:32.391672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:32.392483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:32.393002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:32.393492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:32.537228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:32.545997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:32.547422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:32.548627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-028ac4bb-6bc1-45d5-a916-03be687c8eb9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.170671 Sep 07 08:01:32.549181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 414/853] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:32 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:32.996896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:32.997600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:33.004553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:33.005079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:33.005474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:33.006165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:33.006614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:33.007034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:33.165649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:33.174986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3a704e15-b14d-4dcb-adf0-8be8673a49d5 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.181966 Sep 07 08:01:33.175554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 440/854] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:32 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:33.564432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0e7701d-175b-4854-a3bd-d9fac98fcec0"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:33.566779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:33.573047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:33.573283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:33.573655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:33.573781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:33.574175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:33.574864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:33.575316 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:33.575784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:33.579734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:33.580259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:33.580698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:33.581394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:33.581852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:33.582280 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:33.600398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:33.718247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:33.726220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:33.727691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:33.728848 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84ac4e57-30e8-427e-a59a-ceb723e70743 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.159637 Sep 07 08:01:33.729402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 441/855] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:33 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:01:34.199222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:34.199860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:34.206746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:34.207224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:34.207657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:34.208363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:34.208821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:34.209267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:34.343524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:34.351226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b9894327-4114-49fb-8389-804fb190bb3a tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.155840 Sep 07 08:01:34.351785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 442/856] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:34 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:01:34.680431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:34.691444 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-081e4299-21cf-4314-be9b-2af2a6df5d20 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "POST /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.131883 Sep 07 08:01:34.692046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 415/857] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 08:01:33 2022] POST /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments => generated 194 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:34.758034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:34.758756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:34.765640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:34.766119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:34.766569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:34.767248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:34.767698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:34.768158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:34.895652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:34.903790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:34.905285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:34.906444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d34b5d42-4034-4628-b636-e13974cdbef9 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.152329 Sep 07 08:01:34.907002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 443/858] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:34 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:35.376345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:35.377049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:35.383634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:35.384156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:35.384607 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:35.385306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:35.385764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:35.386191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:35.521225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:35.529400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4b108dc0-2b9a-449e-9e68-0c8b08001907 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.157822 Sep 07 08:01:35.530064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 416/859] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:35 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:35.931471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:35.932109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:35.938956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:35.939438 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:35.939875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:35.940595 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:35.941053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:35.941480 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:36.075791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:36.084567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:36.086070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:36.087238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d1c3fc62-1b12-4122-a4f5-40f9d0cfab35 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.159734 Sep 07 08:01:36.087789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 444/860] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:35 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:36.552619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:36.553275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:36.559607 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:36.560683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:36.561113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:36.561791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:36.562235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:36.562895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:36.696106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:36.703761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22cb5a58-aa50-41c5-bd5d-10b24fa55e6e tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.154997 Sep 07 08:01:36.704355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 417/861] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:36 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:37.112875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:37.113486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:37.119913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:37.120431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:37.120873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:37.121561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:37.122019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:37.122614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:37.251251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:37.259316 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:37.260808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:37.261963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dfbee5c8-d0fe-457d-8547-f6818afdc2e8 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.153112 Sep 07 08:01:37.262516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 445/862] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:37 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:37.738678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:37.739423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:37.749953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=64 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:37.771122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:37.772856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:37.774064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:37.775845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:37.776428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:37.777828 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:37.939150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:37.946723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-20d50517-9274-4ceb-afdb-dbae6efd4751 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1575 microversion: 2.1 time: 0.220325 Sep 07 08:01:37.947282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 418/863] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:37 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:38.288214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:38.288828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:38.295997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:38.296510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:38.296949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:38.297644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:38.298105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:38.298525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:38.435862 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:38.444248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:38.445713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:38.446877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1c8f27f-48ae-4936-8bfc-6ed429a8556e tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.162584 Sep 07 08:01:38.447434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 446/864] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:38 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:38.971341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:38.971951 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:38.978842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:38.979374 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:38.979800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:38.980534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:38.981161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:38.981572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:39.178286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:39.186947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-af5bb8a9-855a-4ae8-aaa3-05ebc09d1994 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1562 microversion: 2.1 time: 0.220672 Sep 07 08:01:39.187510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 419/865] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:38 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:39.471968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:39.472543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:39.478908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:39.479382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:39.479813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:39.480527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:39.480975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:39.481393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:39.609903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:39.617869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:39.619312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:39.620486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-494a1e1c-ed63-44c8-855c-bbe87bc20ea0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.152424 Sep 07 08:01:39.621043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 447/866] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:39 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:39.907084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-002c20de-ba74-4f5f-98d8-283cbb32f7ce req-0bb3951d-4872-4453-a9ae-3eb1977096e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b921f49-ab37-4207-8301-4d822f5cebaf", "name": "network-vif-plugged", "status": "completed", "tag": "e8074f9b-36f4-44cb-a791-0408a89aa4d8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:39.918221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-002c20de-ba74-4f5f-98d8-283cbb32f7ce req-0bb3951d-4872-4453-a9ae-3eb1977096e4 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:39.918819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-002c20de-ba74-4f5f-98d8-283cbb32f7ce req-0bb3951d-4872-4453-a9ae-3eb1977096e4 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:39.919951 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-002c20de-ba74-4f5f-98d8-283cbb32f7ce req-0bb3951d-4872-4453-a9ae-3eb1977096e4 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:39.941587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-002c20de-ba74-4f5f-98d8-283cbb32f7ce req-0bb3951d-4872-4453-a9ae-3eb1977096e4 service nova] Creating event network-vif-plugged:e8074f9b-36f4-44cb-a791-0408a89aa4d8 for instance 5b921f49-ab37-4207-8301-4d822f5cebaf on hv-cinder-83602 Sep 07 08:01:39.946776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-002c20de-ba74-4f5f-98d8-283cbb32f7ce req-0bb3951d-4872-4453-a9ae-3eb1977096e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044037 Sep 07 08:01:39.947530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 420/867] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:40.646083 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:40.646685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:40.653181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:40.654292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:40.654729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:40.655415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:40.655870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:40.656327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:40.786746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:40.795345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:40.796824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:40.797964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be4e3041-8ce3-468e-8504-ab82a3041f62 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.155843 Sep 07 08:01:40.798513 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 448/868] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:40 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:41.825553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:41.826277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:41.832415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:41.832906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:41.833346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:41.834030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:41.834485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:41.834914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:41.962707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:41.970976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:41.972453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:41.973610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-017296f5-efbe-4f60-9b02-09c685047b57 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.152992 Sep 07 08:01:41.974173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 421/869] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:41 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:42.999512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:43.000165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:43.006632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:43.007109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:43.007539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:43.008255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:43.008706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:43.009126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:43.141834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:43.150001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:43.151455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:43.152630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6ac8c11-9324-4616-8801-26e4a21af4b3 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.157723 Sep 07 08:01:43.153193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 449/870] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:42 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:44.178297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:44.178933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:44.185602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:44.186081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:44.186510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:44.187188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:44.187895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:44.188344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:44.329637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:44.337827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:44.339251 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:44.340415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8ef00027-a4d9-43bd-a555-0f3ca5964a05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.165967 Sep 07 08:01:44.341116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 422/871] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:44 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:45.365911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:45.366535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:45.373385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:45.374153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:45.374635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:45.375361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:45.375824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:45.376294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:45.542892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:45.551576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:45.553069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:45.554240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44f38d75-40fc-4316-a6eb-01a5a7902834 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1731 microversion: 2.20 time: 0.192327 Sep 07 08:01:45.554793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 450/872] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:45 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:46.579954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:46.580652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:46.587245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:46.587722 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:46.587875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:46.588291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:46.588409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:46.588849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:46.589296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:46.589716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:46.595296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:46.595804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:46.596261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:46.596948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:46.597399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:46.597815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:46.678514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lazy-loading 'services' on Instance uuid c787e574-99cb-4b1c-a959-6c1595193b84 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:01:46.727864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:46.737313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:46.738771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:46.739916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22ff196c-75e2-49e9-ab5b-24c5a712031b tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1718 microversion: 2.20 time: 0.163990 Sep 07 08:01:46.740698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 423/873] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:01:46 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:01:46.766708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-be12b9fe-526d-44fb-9ada-610036413fd4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments/d0e7701d-175b-4854-a3bd-d9fac98fcec0" status: 202 len: 0 microversion: 2.1 time: 0.182546 Sep 07 08:01:46.767304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 451/874] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 08:01:46 2022] DELETE /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments/d0e7701d-175b-4854-a3bd-d9fac98fcec0 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 08:01:46.775835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:46.778236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:46.785070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:46.785723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:46.786185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:46.787060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:46.787496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:46.788056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:46.819357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-92c9459f-8111-40ae-81ed-3855825478ca tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047366 Sep 07 08:01:46.819919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 424/875] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:01:46 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:01:47.832951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:47.835289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:47.841689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:47.842173 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:47.842610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:47.843297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:47.843754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:47.844214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:47.874593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e4e390e-f31e-476f-bf56-60de385abaf3 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Sep 07 08:01:47.875171 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 452/876] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:01:47 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:48.887329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:48.890102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:48.896407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:48.896887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:48.897359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:48.898040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:48.898490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:48.898910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:48.930850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1a757a27-9641-4003-a8dd-a7dd724cb6c2 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047567 Sep 07 08:01:48.931313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 425/877] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:01:48 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:49.943203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:49.945361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:49.953117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:49.953868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:49.954374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:49.955072 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:49.955527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:49.955949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:49.985226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc5dd1b4-2849-4ef6-b202-8369009e7b1b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045801 Sep 07 08:01:49.985778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 453/878] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:01:49 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 08:01:50.050392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:50.050920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:50.057237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:50.057714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:50.058143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:50.058824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:50.059277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:50.059699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:50.085563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:01:50.164191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-368cef57-6f18-45c3-bc3e-691189082c6b tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 204 len: 0 microversion: 2.1 time: 0.117989 Sep 07 08:01:50.164781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 426/879] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:01:50 2022] DELETE /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:01:50.173648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:50.174290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:50.180230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:50.180712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:50.181140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:50.181819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:50.182317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:50.182750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:50.315690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:50.323295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6d823a37-4f66-436f-a801-97954edcf1a4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1678 microversion: 2.1 time: 0.153881 Sep 07 08:01:50.323848 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 454/880] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:50 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:51.348243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:51.348949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:51.355393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:51.355879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:51.356349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:51.357073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:51.357531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:51.357959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:51.497690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:51.505558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dcb8e748-4282-496f-8d17-2573c84ff757 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1678 microversion: 2.1 time: 0.161776 Sep 07 08:01:51.506118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 427/881] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:51 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:52.529448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:52.530654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:52.538856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:52.539506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:52.540170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:52.541273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:52.542419 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:52.543002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:52.691887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:52.699553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39f55d17-97f0-468f-8258-40bf7ff93c2c tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1678 microversion: 2.1 time: 0.174148 Sep 07 08:01:52.700137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 455/882] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:52 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:53.243306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-43d21cc0-e14c-4515-8c64-9dffc83b2f5c req-d8e1ea76-c897-43cb-8cdb-71e7188b18a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787e574-99cb-4b1c-a959-6c1595193b84", "name": "network-vif-deleted", "tag": "7ed9a1d9-5935-41b5-90dd-4dae497cc7e5"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:01:53.256573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-43d21cc0-e14c-4515-8c64-9dffc83b2f5c req-d8e1ea76-c897-43cb-8cdb-71e7188b18a7 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:53.257058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-43d21cc0-e14c-4515-8c64-9dffc83b2f5c req-d8e1ea76-c897-43cb-8cdb-71e7188b18a7 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:53.257484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-43d21cc0-e14c-4515-8c64-9dffc83b2f5c req-d8e1ea76-c897-43cb-8cdb-71e7188b18a7 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:53.270381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-43d21cc0-e14c-4515-8c64-9dffc83b2f5c req-d8e1ea76-c897-43cb-8cdb-71e7188b18a7 service nova] Creating event network-vif-deleted:7ed9a1d9-5935-41b5-90dd-4dae497cc7e5 for instance c787e574-99cb-4b1c-a959-6c1595193b84 on hv-cinder-83602 Sep 07 08:01:53.275541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-43d21cc0-e14c-4515-8c64-9dffc83b2f5c req-d8e1ea76-c897-43cb-8cdb-71e7188b18a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035940 Sep 07 08:01:53.276369 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 428/883] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:01:53.722500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:53.723106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:53.730223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:53.730712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:53.731145 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:53.732037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:53.732681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:53.733743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:53.769423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:53.769916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:53.770483 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:53.770951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lazy-loading 'fault' on Instance uuid c787e574-99cb-4b1c-a959-6c1595193b84 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:01:53.818818 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07bc40275734f628fcc2f62dd4dd0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a6411dd18c4b6a8fad228058c8e06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:01:53.828025 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-493a8e02-fad7-4251-874d-d12fec83259f tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 200 len: 1329 microversion: 2.1 time: 0.109393 Sep 07 08:01:53.843958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 456/884] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:53 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 1329 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:01:54.854000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:54.854700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:54.862443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:54.862952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:54.863384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:54.864324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:54.864918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:54.865349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:54.879695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 HTTP/1.1 Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:01:54.881535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:54.883182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': 'c787e574-99cb-4b1c-a959-6c1595193b84'} Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:54.884141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:54.885627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:54.887563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:54.887563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e0a2c1ae-0021-430b-9ece-4943f242ba93 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 404 len: 111 microversion: 2.1 time: 0.033540 Sep 07 08:01:54.887563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 429/885] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:54 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:54.892900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42792f9c-41f6-42cf-876d-285e6ffbca44 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '.version_select at 0x7f831ea07ca0>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:54.911959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42792f9c-41f6-42cf-876d-285e6ffbca44 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212630200" status: 202 len: 0 microversion: 2.1 time: 0.022881 Sep 07 08:01:54.912561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 457/886] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Sep 7 08:01:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212630200 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:01:56.693088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:56.693573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:56.699974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:56.700494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:56.700923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:56.701604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:56.702554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:56.702998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:56.716268 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 HTTP/1.1 Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:01:56.718423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.720022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': 'c787e574-99cb-4b1c-a959-6c1595193b84'} Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:56.720861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.722392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.723850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:56.723850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c3bc63c6-3b9e-45f6-a6d5-24d6385273f1 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 404 len: 111 microversion: 2.1 time: 0.030464 Sep 07 08:01:56.723850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 430/887] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:01:56 2022] DELETE /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:56.729144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:56.729755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: c787e574-99cb-4b1c-a959-6c1595193b84] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:56.736229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:56.736710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:56.737146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:56.737829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:56.738279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:56.738704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:56.743372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:56.752701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 HTTP/1.1 Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:01:56.754328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.755890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'c787e574-99cb-4b1c-a959-6c1595193b84'} Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:56.756809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. Sep 07 08:01:56.758077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:56.759137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance c787e574-99cb-4b1c-a959-6c1595193b84 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:56.759137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-606036b4-d17b-4e24-9bd3-bfb0baf62ea4 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84" status: 404 len: 111 microversion: 2.1 time: 0.031181 Sep 07 08:01:56.759570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 458/888] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:56 2022] GET /compute/v2.1/servers/c787e574-99cb-4b1c-a959-6c1595193b84 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:57.901532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:57.902033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:57.908963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:57.909438 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:57.909868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:57.910545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:57.910994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:57.911412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:57.925248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab HTTP/1.1 Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:01:57.926762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.928575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '6296be2b-713c-4cc7-9c5e-6ddd1388bdab'} Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:57.930151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.931922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.933450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:57.933450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-203a3139-67e5-4e71-872b-f4282ea1dc14 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 404 len: 111 microversion: 2.1 time: 0.030401 Sep 07 08:01:57.933450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 431/889] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:01:57 2022] DELETE /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:57.936827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:57.937700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6296be2b-713c-4cc7-9c5e-6ddd1388bdab] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:57.944578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:57.945062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:57.945500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:57.946196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:57.946659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:57.947084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:57.960457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab HTTP/1.1 Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:01:57.962004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.963553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '6296be2b-713c-4cc7-9c5e-6ddd1388bdab'} Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:57.964949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. Sep 07 08:01:57.967965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.969640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance 6296be2b-713c-4cc7-9c5e-6ddd1388bdab could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:57.969640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e2f82e3-ce8e-438f-b409-67ecf80a41cc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab" status: 404 len: 111 microversion: 2.1 time: 0.030762 Sep 07 08:01:57.969640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 459/890] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:57 2022] GET /compute/v2.1/servers/6296be2b-713c-4cc7-9c5e-6ddd1388bdab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:57.972665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:57.973165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:57.986609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:57.986609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:57.986609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:57.986609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:57.986970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:57.986970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:57.995777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b HTTP/1.1 Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:01:57.997465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:57.999073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': 'f6a6fa25-3c84-48c7-a503-524e02cbb19b'} Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:57.999865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:58.001174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.002567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:58.002567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-81be0248-5407-4451-b86b-fc65ebfbaebc tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 404 len: 111 microversion: 2.1 time: 0.030128 Sep 07 08:01:58.002567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 432/891] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:01:57 2022] DELETE /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 08:01:58.007091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:58.007710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: f6a6fa25-3c84-48c7-a503-524e02cbb19b] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:58.013556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:58.014040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:58.014515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:58.015205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:58.015660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:58.016109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:58.029344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b HTTP/1.1 Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:01:58.031783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:58.033354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'f6a6fa25-3c84-48c7-a503-524e02cbb19b'} Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:58.034213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. Sep 07 08:01:58.035374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:58.036506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance f6a6fa25-3c84-48c7-a503-524e02cbb19b could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:58.036506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21448fb7-b932-4d56-9fad-ddf0c1c046cd tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b" status: 404 len: 111 microversion: 2.1 time: 0.029907 Sep 07 08:01:58.036506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 460/892] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:58 2022] GET /compute/v2.1/servers/f6a6fa25-3c84-48c7-a503-524e02cbb19b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:59.174796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:59.175281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:59.181571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:59.182051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:59.182483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:59.183161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:59.183612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:59.184033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:59.197992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 HTTP/1.1 Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:01:59.199574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.201166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '6f3a1e65-1d0a-4462-928c-e0b7610c2180'} Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:59.202175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.203498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.204686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:59.204686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-088db511-fc76-4bc0-b0e0-12e9e3306391 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 404 len: 111 microversion: 2.1 time: 0.030640 Sep 07 08:01:59.204686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 433/893] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:01:59 2022] DELETE /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:01:59.209694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:01:59.210313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] [instance: 6f3a1e65-1d0a-4462-928c-e0b7610c2180] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:01:59.212645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:01:59.218569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:59.219055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:59.219489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:59.220216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:01:59.220675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:01:59.221102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:01:59.238434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] HTTP exception thrown: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Request method failure captured: Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 HTTP/1.1 Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5vgBxEnYkoqsnVX-_aUxuf62MeG-dCsxVTwiAMy8PnXF9Mm9JYwBavx1zahhoEfA2-FmZEFL5UMEe0hll3MBKYo1TR65H_vm6bB-buDueyFL9giYOJO-_s22upWmr2Fs3YSTgmRHbSnbiC8feTE9wSN2eSs8x3YL9qISV50A5nX1E Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:01:59.239964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09a6411dd18c4b6a8fad228058c8e06b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09a6411dd18c4b6a8fad228058c8e06b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 09a6411dd18c4b6a8fad228058c8e06b Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-579894891 Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: e07bc40275734f628fcc2f62dd4dd0e0 Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeNegativeTest-579894891-project Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.241535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '6f3a1e65-1d0a-4462-928c-e0b7610c2180'} Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:01:59.242384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. Sep 07 08:01:59.243895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:01:59.245253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] Returning 404 to user: Instance 6f3a1e65-1d0a-4462-928c-e0b7610c2180 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:01:59.245253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9831829e-8499-4b42-9899-3873da091e50 tempest-AttachVolumeNegativeTest-579894891 tempest-AttachVolumeNegativeTest-579894891-project] 10.222.0.26 "GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180" status: 404 len: 111 microversion: 2.1 time: 0.035670 Sep 07 08:01:59.245253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 461/894] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:01:59 2022] GET /compute/v2.1/servers/6f3a1e65-1d0a-4462-928c-e0b7610c2180 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:02:08.607152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:08.608386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:08.610341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:08.616194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:08.617138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:08.617613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:08.618358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:08.618821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:08.619287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:08.624040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=89,nova_cell1:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:08.645923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8dcbdd7a-0cb8-439d-b949-6f8ec6016ca1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/ips" status: 200 len: 146 microversion: 2.1 time: 0.278867 Sep 07 08:02:08.646482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 434/895] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 7 08:02:08 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/ips => generated 146 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:10.011825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee28c6e-301e-4499-a2f1-967326227499"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:10.014874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:10.017420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=6 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:10.018460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:10.023905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:10.024423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:10.024861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:10.025566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:10.026029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:10.026455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:10.307829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53e43bcf-51c3-4757-9ecb-171df0c14fd4 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299741 Sep 07 08:02:10.314820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 462/896] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 08:02:10 2022] POST /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:17.892964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:17.895270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:17.903745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:17.904280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:17.904716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:17.905677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:17.906301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:17.906735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:17.938748 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e2c68633-6194-4713-82c3-c6ca3545c0ae tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050175 Sep 07 08:02:17.939527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 435/897] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:02:17 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:17.951418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:17.952000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:17.958769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:17.959447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:17.959885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:17.960800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:17.961267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:17.961688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:17.992732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-182955ee-c3bb-4584-87c7-ad65f7bb452d tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/2ee28c6e-301e-4499-a2f1-967326227499" status: 200 len: 194 microversion: 2.1 time: 0.046314 Sep 07 08:02:17.993589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 463/898] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Sep 7 08:02:17 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/2ee28c6e-301e-4499-a2f1-967326227499 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:19.378096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3c7d829-5852-4db3-abbb-d7470765b06b"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:19.380636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:19.387584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:19.388051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:19.388660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:19.389245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:19.389847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:19.390399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:19.688201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f8c26231-2a4e-48e2-9fc6-5d3723049b43 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "POST /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314095 Sep 07 08:02:19.689090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 436/899] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 08:02:19 2022] POST /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:26.394947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:26.397320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:26.403681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:26.404196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:26.404637 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:26.405338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:26.405796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:26.406225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:26.437531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-79d148a5-ab1b-4312-b9d9-7a811d38a5db tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045510 Sep 07 08:02:26.438002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 464/900] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Sep 7 08:02:26 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:26.509695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:26.510290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:26.517339 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:26.517819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:26.518255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:26.518943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:26.519399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:26.519844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:26.546761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:02:26.626836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c3f62483-446a-4017-a4f8-60d7b6753c05 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 204 len: 0 microversion: 2.20 time: 0.121221 Sep 07 08:02:26.628277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 437/901] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 7 08:02:26 2022] DELETE /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 08:02:26.636390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:26.637004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:26.643212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:26.643697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:26.644166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:26.644862 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:26.645320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:26.645738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:26.785149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:26.793223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:26.794672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:26.796550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0129f59a-4a9d-493c-994b-b341fa820e87 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.163444 Sep 07 08:02:26.797232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 465/902] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:02:26 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:02:27.823108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:27.823803 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:27.830530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:27.831126 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:27.831563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:27.832308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:27.832780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:27.833237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:27.977107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:27.985867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:27.987345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:27.988510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d754493c-8c08-4d19-b6d5-11ea9dd2db82 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.169741 Sep 07 08:02:27.989061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 438/903] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:02:27 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:02:28.304707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:28.307038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:28.315890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:28.316516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:28.317051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:28.317885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:28.318420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:28.318943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:28.355635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-caa69687-260f-4602-bbeb-3c1d16a5dbe0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054877 Sep 07 08:02:28.356443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 466/904] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:02:28 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:28.504191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:28.504894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:28.512072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:28.512921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:28.518028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:28.519258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:28.523630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:28.524334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:28.559526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2c8879b3-989a-4634-9d65-360c1354cf60 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/2ee28c6e-301e-4499-a2f1-967326227499" status: 200 len: 194 microversion: 2.1 time: 0.059600 Sep 07 08:02:28.560802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 439/905] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Sep 7 08:02:28 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/2ee28c6e-301e-4499-a2f1-967326227499 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:02:28.572311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:28.574550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:28.581378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:28.583593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:28.584371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:28.585087 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:28.585687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:28.586234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:28.690271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lazy-loading 'services' on Instance uuid 07ac8466-b0bf-4936-a910-9ac7e096614e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:02:28.785833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42444f48-4d09-4b8c-b68b-e699d1099103 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/2ee28c6e-301e-4499-a2f1-967326227499" status: 202 len: 0 microversion: 2.1 time: 0.218006 Sep 07 08:02:28.786604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 467/906] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 08:02:28 2022] DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/2ee28c6e-301e-4499-a2f1-967326227499 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:02:29.016891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:29.017498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:29.023771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:29.024528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:29.024966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:29.025791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:29.026109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:29.026527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:29.259187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:29.270270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:29.272138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:29.273347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-61738034-acdb-471d-ba5f-94a1ac53efa6 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1724 microversion: 2.20 time: 0.261001 Sep 07 08:02:29.273893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 440/907] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:02:29 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 08:02:30.302218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:30.304402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:30.321183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:30.321778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:30.322284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:30.325925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:30.326505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:30.328034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:30.363773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6fcaef42-3375-484c-a9b3-c7fd26e1dc5a req-0a29cacd-1ff6-497b-b59e-7897af613043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b921f49-ab37-4207-8301-4d822f5cebaf", "name": "network-vif-deleted", "tag": "e8074f9b-36f4-44cb-a791-0408a89aa4d8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:30.392586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6fcaef42-3375-484c-a9b3-c7fd26e1dc5a req-0a29cacd-1ff6-497b-b59e-7897af613043 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:30.397899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6fcaef42-3375-484c-a9b3-c7fd26e1dc5a req-0a29cacd-1ff6-497b-b59e-7897af613043 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:30.398920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6fcaef42-3375-484c-a9b3-c7fd26e1dc5a req-0a29cacd-1ff6-497b-b59e-7897af613043 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:30.453337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:30.463219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:30.465220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '457d69a7306d46cd8445f887eb95c517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18463a34e4aa4b89a2a9ccad75a0d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:30.466882 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c7d993c9-3a84-422e-ab32-261ea1d397a0 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 200 len: 1656 microversion: 2.20 time: 0.171096 Sep 07 08:02:30.467245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6fcaef42-3375-484c-a9b3-c7fd26e1dc5a req-0a29cacd-1ff6-497b-b59e-7897af613043 service nova] Creating event network-vif-deleted:e8074f9b-36f4-44cb-a791-0408a89aa4d8 for instance 5b921f49-ab37-4207-8301-4d822f5cebaf on hv-cinder-83602 Sep 07 08:02:30.468840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 468/908] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:02:30 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 1656 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 08:02:30.481412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6fcaef42-3375-484c-a9b3-c7fd26e1dc5a req-0a29cacd-1ff6-497b-b59e-7897af613043 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120955 Sep 07 08:02:30.485187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 441/909] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:30.992612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:30.993203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:31.002554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:31.003314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:31.004120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:31.005040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:31.005914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:31.006551 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:31.047242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8451a14a-29d2-4cae-b987-9b9c75db44c3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/b3c7d829-5852-4db3-abbb-d7470765b06b" status: 200 len: 194 microversion: 2.1 time: 0.058947 Sep 07 08:02:31.048483 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 469/910] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Sep 7 08:02:30 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/b3c7d829-5852-4db3-abbb-d7470765b06b => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:31.062897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:31.063517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:31.069896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:31.070577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:31.071237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:31.071872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:31.072358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:31.072966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:31.189160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lazy-loading 'services' on Instance uuid 07ac8466-b0bf-4936-a910-9ac7e096614e {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:02:31.270307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d4569b08-278a-4d4d-9b84-6ea8bbbcbdd5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/b3c7d829-5852-4db3-abbb-d7470765b06b" status: 202 len: 0 microversion: 2.1 time: 0.214464 Sep 07 08:02:31.270985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 442/911] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 08:02:31 2022] DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments/b3c7d829-5852-4db3-abbb-d7470765b06b => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:02:31.495509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:31.496044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:31.503442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:31.503932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:31.504396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:31.505106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:31.505560 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:31.505988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:31.520725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] HTTP exception thrown: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Request method failure captured: Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf HTTP/1.1 Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5v3gFQmvtD0L9VIdTBc6nD6Hm_p9a_K5IbHEAmhnFPQww1VR2SW1VL2aRgfw7_DyTDOaePKyldwyqVRhHlIJ7bd834rh5I7Iy0W3LQb6z-UdxIVndAP1dFy6OGVUtufaJIvjoHmAgctG2lb8bCnwHq1aQMGnZp-xJEqPetsHEzhBQ Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:02:31.522344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18463a34e4aa4b89a2a9ccad75a0d81e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 457d69a7306d46cd8445f887eb95c517 Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:31.523983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '5b921f49-ab37-4207-8301-4d822f5cebaf'} Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:31.524931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:31.526468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:31.527813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Returning 404 to user: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:31.527813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-53ee9bc1-f6b0-43b0-b762-ae6241994794 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 404 len: 111 microversion: 2.20 time: 0.032280 Sep 07 08:02:31.527813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 470/912] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:02:31 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 08:02:31.534898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1e223c43-6e64-4300-8430-b5c6e12a20dc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '.version_select at 0x7f831e9b60d0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:31.556004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1e223c43-6e64-4300-8430-b5c6e12a20dc tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668409808" status: 204 len: 0 microversion: 2.20 time: 0.026552 Sep 07 08:02:31.556602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 443/913] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Sep 7 08:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668409808 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 08:02:32.249734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-797173072", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "networks": [{"uuid": "c5b37a94-5dcd-46a4-ae87-43012d4ab2c7"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:32.313616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] validate_networks() for [('c5b37a94-5dcd-46a4-ae87-43012d4ab2c7', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:02:32.461267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:32.463628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:32.471423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.471920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.472394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.473101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.473562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.473994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.504123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-32c188c2-4f3c-435f-9b2b-44221cc8b1f3 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046787 Sep 07 08:02:32.504696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 444/914] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:02:32 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 08:02:32.626621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:32.628800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:32.635771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.636289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.636727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.637412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.637861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.638281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.668592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-84cfd24e-9be7-41d8-a327-b720c792609c tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046426 Sep 07 08:02:32.669253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 445/915] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 7 08:02:32 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 08:02:32.698509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:02:32.698989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:02:32.699399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:02:32.699808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:02:32.700263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:02:32.709068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.709555 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.709988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.710715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.711170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.711595 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.732219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Getting quotas for project b7f7a616ffc84d23af3691a2672a6829. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:02:32.736136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:32.736611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:32.736775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Getting quotas for user 7a67efdb6af84cfb92df1be6d8345ea9 and project b7f7a616ffc84d23af3691a2672a6829. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:02:32.742406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.742890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.743322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.744007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.744490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.744925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.747843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:02:32.751132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:02:32.770319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:02:32.798206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-81c7240b-568d-4d04-9246-34b917f52a0d tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552990 Sep 07 08:02:32.799040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 471/916] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 08:02:32.810183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91504c83-a9ef-45d3-a066-12b5f5bcfc9f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:32.810823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91504c83-a9ef-45d3-a066-12b5f5bcfc9f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:32.861100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ee603a5a-0da8-43f3-b88f-64e7ecf0dce2 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 204 len: 0 microversion: 2.1 time: 0.129114 Sep 07 08:02:32.863359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 446/917] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:02:32 2022] DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 08:02:32.869713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-91504c83-a9ef-45d3-a066-12b5f5bcfc9f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:32.871034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:32.871743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:32.878424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91504c83-a9ef-45d3-a066-12b5f5bcfc9f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1213 microversion: 2.1 time: 0.072299 Sep 07 08:02:32.880683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.881183 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.881619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.882322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:32.882777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:32.883202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:32.884220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 472/918] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:32 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:32.899938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:33.030736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:33.040159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-91b9cb2b-7db0-4925-880e-a2a97e82a85a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1673 microversion: 2.1 time: 0.173399 Sep 07 08:02:33.041974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 447/919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:32 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:33.355456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:33.355957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:33.362104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:33.362589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:33.363018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:33.363700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:33.364181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:33.364604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:33.377490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] HTTP exception thrown: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Request method failure captured: Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf HTTP/1.1 Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5v3gFQmvtD0L9VIdTBc6nD6Hm_p9a_K5IbHEAmhnFPQww1VR2SW1VL2aRgfw7_DyTDOaePKyldwyqVRhHlIJ7bd834rh5I7Iy0W3LQb6z-UdxIVndAP1dFy6OGVUtufaJIvjoHmAgctG2lb8bCnwHq1aQMGnZp-xJEqPetsHEzhBQ Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:02:33.379033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18463a34e4aa4b89a2a9ccad75a0d81e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 457d69a7306d46cd8445f887eb95c517 Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.380742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '5b921f49-ab37-4207-8301-4d822f5cebaf'} Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:33.381590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.383065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.384838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Returning 404 to user: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:33.384838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-49a91aa2-996c-48db-95a5-00cc4b977157 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 404 len: 111 microversion: 2.20 time: 0.028791 Sep 07 08:02:33.384838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 473/920] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 7 08:02:33 2022] DELETE /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 08:02:33.389796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:33.390407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 5b921f49-ab37-4207-8301-4d822f5cebaf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:33.396434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:33.396917 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:33.397351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:33.398069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:33.398523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:33.398949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:33.412494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] HTTP exception thrown: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Request method failure captured: Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf HTTP/1.1 Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5v3gFQmvtD0L9VIdTBc6nD6Hm_p9a_K5IbHEAmhnFPQww1VR2SW1VL2aRgfw7_DyTDOaePKyldwyqVRhHlIJ7bd834rh5I7Iy0W3LQb6z-UdxIVndAP1dFy6OGVUtufaJIvjoHmAgctG2lb8bCnwHq1aQMGnZp-xJEqPetsHEzhBQ Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:02:33.414063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18463a34e4aa4b89a2a9ccad75a0d81e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 457d69a7306d46cd8445f887eb95c517 Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.415668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '5b921f49-ab37-4207-8301-4d822f5cebaf'} Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:33.416605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. Sep 07 08:02:33.418035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:33.419350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Returning 404 to user: Instance 5b921f49-ab37-4207-8301-4d822f5cebaf could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:33.419350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2fe45d6e-142f-4d11-b53b-39e776a4af6a tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf" status: 404 len: 111 microversion: 2.20 time: 0.030170 Sep 07 08:02:33.419350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 448/921] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:02:33 2022] GET /compute/v2.1/servers/5b921f49-ab37-4207-8301-4d822f5cebaf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 08:02:33.901485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:33.902092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:33.908721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:33.909197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:33.909627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:33.910301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:33.910756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:33.911170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:33.971198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:33.978792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9aa83360-d079-49bb-8ec2-ccedc38d1a13 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1217 microversion: 2.1 time: 0.081142 Sep 07 08:02:33.979347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 474/922] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:33 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:34.070606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:34.071246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:34.078546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:34.079131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:34.079662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:34.080453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:34.080907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:34.081329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:34.219333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:34.227410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c3f7c438-9a87-489c-9129-c15f8582438b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1673 microversion: 2.1 time: 0.160599 Sep 07 08:02:34.227999 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 449/923] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:34 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:34.555136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:34.555662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:34.562130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:34.562673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:34.563111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:34.563790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:34.564275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:34.564699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:34.578362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] HTTP exception thrown: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Request method failure captured: Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb HTTP/1.1 Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE5v3gFQmvtD0L9VIdTBc6nD6Hm_p9a_K5IbHEAmhnFPQww1VR2SW1VL2aRgfw7_DyTDOaePKyldwyqVRhHlIJ7bd834rh5I7Iy0W3LQb6z-UdxIVndAP1dFy6OGVUtufaJIvjoHmAgctG2lb8bCnwHq1aQMGnZp-xJEqPetsHEzhBQ Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:02:34.580184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18463a34e4aa4b89a2a9ccad75a0d81e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 457d69a7306d46cd8445f887eb95c517 Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.582381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '86bf06d0-30dc-4a08-94a4-bac302f07efb'} Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:34.583315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.584924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.586406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Returning 404 to user: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:34.586406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bdce7f39-4410-4e8a-8322-459b610a461f tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 404 len: 111 microversion: 2.20 time: 0.030496 Sep 07 08:02:34.586406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 475/924] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 7 08:02:34 2022] DELETE /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 08:02:34.590451 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:34.591057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] [instance: 86bf06d0-30dc-4a08-94a4-bac302f07efb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:34.597426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:34.597910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:34.598341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:34.599020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:34.599467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:34.599883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:34.614152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] HTTP exception thrown: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Request method failure captured: Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb HTTP/1.1 Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE5v3gFQmvtD0L9VIdTBc6nD6Hm_p9a_K5IbHEAmhnFPQww1VR2SW1VL2aRgfw7_DyTDOaePKyldwyqVRhHlIJ7bd834rh5I7Iy0W3LQb6z-UdxIVndAP1dFy6OGVUtufaJIvjoHmAgctG2lb8bCnwHq1aQMGnZp-xJEqPetsHEzhBQ Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:02:34.615838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18463a34e4aa4b89a2a9ccad75a0d81e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18463a34e4aa4b89a2a9ccad75a0d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 18463a34e4aa4b89a2a9ccad75a0d81e Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-815393587 Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 457d69a7306d46cd8445f887eb95c517 Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeShelveTestJSON-815393587-project Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.617537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '86bf06d0-30dc-4a08-94a4-bac302f07efb'} Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:34.618373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. Sep 07 08:02:34.619773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:34.620964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] Returning 404 to user: Instance 86bf06d0-30dc-4a08-94a4-bac302f07efb could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:34.620964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e96bb555-ff6d-417f-b736-7cb3df561c36 tempest-AttachVolumeShelveTestJSON-815393587 tempest-AttachVolumeShelveTestJSON-815393587-project] 10.222.0.26 "GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb" status: 404 len: 111 microversion: 2.20 time: 0.030781 Sep 07 08:02:34.620964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 450/925] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 7 08:02:34 2022] GET /compute/v2.1/servers/86bf06d0-30dc-4a08-94a4-bac302f07efb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 08:02:35.001376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:35.002021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:35.008544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:35.009152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:35.009588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:35.010285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:35.010744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:35.011166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:35.102432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:35.110393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8976c8dc-df15-4eb7-bf0a-d902b9ab76d7 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1265 microversion: 2.1 time: 0.112845 Sep 07 08:02:35.110958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 476/926] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:34 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:02:35.251255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:35.252375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:35.259064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:35.259642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:35.260168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:35.260933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:35.261511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:35.262000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:35.725895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:35.736715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83eaf227-0a70-4ced-9f8e-af58f16f3ba1 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1673 microversion: 2.1 time: 0.489656 Sep 07 08:02:35.737971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 451/927] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:35 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1673 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:36.133799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:36.134406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:36.141630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:36.142358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:36.142792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:36.143489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:36.143940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:36.144381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:36.221451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:36.229389 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9f32f07-800b-4403-b637-e379815f320c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1271 microversion: 2.1 time: 0.099696 Sep 07 08:02:36.230040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 477/928] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:36 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:36.764508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:36.765467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:36.774610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:36.775301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:36.775873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:36.776751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:36.777602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:36.778065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:36.898199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:36.909289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2617e342-4906-4ced-9b81-9673e624dfb6 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1605 microversion: 2.1 time: 0.149221 Sep 07 08:02:36.910219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 452/929] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:36 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1605 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:37.256195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:37.257173 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:37.267502 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:37.268348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:37.268668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:37.269373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:37.270114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:37.270708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:37.351285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-86e15203-bb60-4522-828b-87f6a772d63c req-3a4b3ec0-ac41-4be8-a65a-dafa21377ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ac8466-b0bf-4936-a910-9ac7e096614e", "name": "network-vif-deleted", "tag": "dc6d946d-0223-4317-bea3-d7cb4c7d36d3"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:37.358484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:37.370320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-86e15203-bb60-4522-828b-87f6a772d63c req-3a4b3ec0-ac41-4be8-a65a-dafa21377ed9 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:37.370836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-86e15203-bb60-4522-828b-87f6a772d63c req-3a4b3ec0-ac41-4be8-a65a-dafa21377ed9 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:37.371335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-86e15203-bb60-4522-828b-87f6a772d63c req-3a4b3ec0-ac41-4be8-a65a-dafa21377ed9 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:37.398140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-56519bc0-b291-460e-8dcb-53a4713dc144 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1271 microversion: 2.1 time: 0.147633 Sep 07 08:02:37.412122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 478/930] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:37 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:37.414941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-86e15203-bb60-4522-828b-87f6a772d63c req-3a4b3ec0-ac41-4be8-a65a-dafa21377ed9 service nova] Creating event network-vif-deleted:dc6d946d-0223-4317-bea3-d7cb4c7d36d3 for instance 07ac8466-b0bf-4936-a910-9ac7e096614e on hv-cinder-83602 Sep 07 08:02:37.429152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-86e15203-bb60-4522-828b-87f6a772d63c req-3a4b3ec0-ac41-4be8-a65a-dafa21377ed9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081967 Sep 07 08:02:37.431490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 453/931] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:37.935477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:37.937406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:37.945834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:37.946945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:37.948131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:37.949916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:37.950779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:37.951967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:37.991325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:37.991989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:37.992724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:37.993381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lazy-loading 'fault' on Instance uuid 07ac8466-b0bf-4936-a910-9ac7e096614e {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:02:38.037906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b97e954da94f909f8f5ffff515509e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3264396aada44ba89f39cfe0776e183e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:38.044360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:38.048765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-814f91b1-8c57-4508-9fcc-4c177eab32a0 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 200 len: 1326 microversion: 2.1 time: 0.118992 Sep 07 08:02:38.049893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 479/932] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:37 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:38.434101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:38.435081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:38.468454 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:38.468962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:38.469387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:38.470118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:38.470586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:38.471016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:38.851823 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:38.863742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2f4e184d-1614-447e-9963-b85f4f287a07 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.440665 Sep 07 08:02:38.864699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 454/933] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:38 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:39.075454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:39.076093 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:39.084637 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:39.085137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:39.085597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:39.086365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:39.086835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:39.087269 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:39.102811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] HTTP exception thrown: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Request method failure captured: Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e HTTP/1.1 Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE7QI0A9wbklRJuku3Wgli2W_n19aHuSVL19Ek-etQsU0_amv4PZREIQvYf0oyMSkRtSlcCh9RdHQ66jh8wuMz354isea5GnOYU31WZM-MbLH2KpXfCKEE4ut3UiTS6mr3Sn0D0D1cbtXMTUKdpxQM2Ne7JeqHL_ObeWnmdN7r0eS6Y Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:02:39.104286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3264396aada44ba89f39cfe0776e183e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 55b97e954da94f909f8f5ffff515509e Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:39.106517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '07ac8466-b0bf-4936-a910-9ac7e096614e'} Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:39.107315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:39.108621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:39.109731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Returning 404 to user: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:39.109731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-280fb0f2-2188-450b-b355-60aa50ceb215 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 404 len: 111 microversion: 2.1 time: 0.034626 Sep 07 08:02:39.109731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 480/934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:39 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:02:39.114915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e31e756a-7974-4df1-a61e-bf4a331228a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '.version_select at 0x7f831e9ab700>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:39.121765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:39.136797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e31e756a-7974-4df1-a61e-bf4a331228a5 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-562315082" status: 202 len: 0 microversion: 2.1 time: 0.025624 Sep 07 08:02:39.137581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 455/935] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Sep 7 08:02:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-562315082 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:02:39.746979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-b9282c6c-f2a0-4da6-b96e-9af69ac8b2cc req-a7e4f5f8-a1f8-40b5-ab34-58f21b5d0033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0154cd6-db30-423b-b2b1-2474366af3ad", "tag": "de9f20c3-f8c8-4d3e-bdba-7abd3d66ec62"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:39.774802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b9282c6c-f2a0-4da6-b96e-9af69ac8b2cc req-a7e4f5f8-a1f8-40b5-ab34-58f21b5d0033 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:39.776301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b9282c6c-f2a0-4da6-b96e-9af69ac8b2cc req-a7e4f5f8-a1f8-40b5-ab34-58f21b5d0033 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:39.787137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-b9282c6c-f2a0-4da6-b96e-9af69ac8b2cc req-a7e4f5f8-a1f8-40b5-ab34-58f21b5d0033 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:39.809321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-b9282c6c-f2a0-4da6-b96e-9af69ac8b2cc req-a7e4f5f8-a1f8-40b5-ab34-58f21b5d0033 service nova] Creating event network-changed:de9f20c3-f8c8-4d3e-bdba-7abd3d66ec62 for instance d0154cd6-db30-423b-b2b1-2474366af3ad on hv-cinder-83602 Sep 07 08:02:39.828256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-b9282c6c-f2a0-4da6-b96e-9af69ac8b2cc req-a7e4f5f8-a1f8-40b5-ab34-58f21b5d0033 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088839 Sep 07 08:02:39.834341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 481/936] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:39.888834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:39.890464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:39.904871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:39.905572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:39.907166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:39.910328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:39.911118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:39.911994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:40.304555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:40.316609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-49d96e08-9555-4083-98e2-a1463cc17ffe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.433710 Sep 07 08:02:40.317468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 456/937] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:39 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:41.344156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:41.345101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:41.347460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:41.354064 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:41.354819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:41.355250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:41.356046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:41.356718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:41.357282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:41.591264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:41.604134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18ea321f-88fa-4419-a742-a8b3692573fe tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.264545 Sep 07 08:02:41.606263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 482/938] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:41 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:42.285233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:42.286347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:42.298281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:42.298897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:42.299326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:42.300061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:42.300791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:42.301206 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:42.316289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] HTTP exception thrown: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Request method failure captured: Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e HTTP/1.1 Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE7QI0A9wbklRJuku3Wgli2W_n19aHuSVL19Ek-etQsU0_amv4PZREIQvYf0oyMSkRtSlcCh9RdHQ66jh8wuMz354isea5GnOYU31WZM-MbLH2KpXfCKEE4ut3UiTS6mr3Sn0D0D1cbtXMTUKdpxQM2Ne7JeqHL_ObeWnmdN7r0eS6Y Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:02:42.318095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3264396aada44ba89f39cfe0776e183e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 55b97e954da94f909f8f5ffff515509e Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.319468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '07ac8466-b0bf-4936-a910-9ac7e096614e'} Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:42.320276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.321491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.322751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Returning 404 to user: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:42.322751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-636d41cd-6de2-4d1d-a1da-6f69b15057ea tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 404 len: 111 microversion: 2.1 time: 0.047179 Sep 07 08:02:42.323215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 457/939] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:02:42 2022] DELETE /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 08:02:42.328819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:42.329686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: 07ac8466-b0bf-4936-a910-9ac7e096614e] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:42.336387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:42.336875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:42.337302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:42.338000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:42.338449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:42.339043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:42.355685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] HTTP exception thrown: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Request method failure captured: Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e HTTP/1.1 Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE7QI0A9wbklRJuku3Wgli2W_n19aHuSVL19Ek-etQsU0_amv4PZREIQvYf0oyMSkRtSlcCh9RdHQ66jh8wuMz354isea5GnOYU31WZM-MbLH2KpXfCKEE4ut3UiTS6mr3Sn0D0D1cbtXMTUKdpxQM2Ne7JeqHL_ObeWnmdN7r0eS6Y Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:02:42.358375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3264396aada44ba89f39cfe0776e183e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 55b97e954da94f909f8f5ffff515509e Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.359736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '07ac8466-b0bf-4936-a910-9ac7e096614e'} Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:42.360542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. Sep 07 08:02:42.361774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:42.362961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Returning 404 to user: Instance 07ac8466-b0bf-4936-a910-9ac7e096614e could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:42.362961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdae45fb-d342-4013-80bd-8f43ad495bb7 tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e" status: 404 len: 111 microversion: 2.1 time: 0.038131 Sep 07 08:02:42.367898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 483/940] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:42 2022] GET /compute/v2.1/servers/07ac8466-b0bf-4936-a910-9ac7e096614e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:02:42.627796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:42.628433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:42.635228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:42.635701 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:42.636265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:42.636845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:42.637299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:42.637722 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:42.806894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:42.819060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fa56908a-9203-49b8-afdb-8569d6ab2ab1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.194983 Sep 07 08:02:42.819705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 458/941] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:42 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:43.522742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:43.523286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:43.525086 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:43.526103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:43.539353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:43.540038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:43.540661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:43.541584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:43.542203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:43.542813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:43.561303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] HTTP exception thrown: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Request method failure captured: Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: DELETE /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 HTTP/1.1 Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGE7QI0A9wbklRJuku3Wgli2W_n19aHuSVL19Ek-etQsU0_amv4PZREIQvYf0oyMSkRtSlcCh9RdHQ66jh8wuMz354isea5GnOYU31WZM-MbLH2KpXfCKEE4ut3UiTS6mr3Sn0D0D1cbtXMTUKdpxQM2Ne7JeqHL_ObeWnmdN7r0eS6Y Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:02:43.564189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3264396aada44ba89f39cfe0776e183e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 55b97e954da94f909f8f5ffff515509e Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.565814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'e625ca1a-4906-44bc-afe5-092b2f95c4d9'} Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:43.567111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.569213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.571423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Returning 404 to user: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:43.571423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ae13a39-d4ba-46ee-9fd5-5ac08fecc25a tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 404 len: 111 microversion: 2.1 time: 0.047668 Sep 07 08:02:43.571423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 484/942] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:02:43 2022] DELETE /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:02:43.575988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:43.577454 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] [instance: e625ca1a-4906-44bc-afe5-092b2f95c4d9] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:43.584692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:43.585248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:43.585895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:43.586668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:43.587126 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:43.587632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:43.601920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] HTTP exception thrown: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Request method failure captured: Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 HTTP/1.1 Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE7QI0A9wbklRJuku3Wgli2W_n19aHuSVL19Ek-etQsU0_amv4PZREIQvYf0oyMSkRtSlcCh9RdHQ66jh8wuMz354isea5GnOYU31WZM-MbLH2KpXfCKEE4ut3UiTS6mr3Sn0D0D1cbtXMTUKdpxQM2Ne7JeqHL_ObeWnmdN7r0eS6Y Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:02:43.603529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3264396aada44ba89f39cfe0776e183e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3264396aada44ba89f39cfe0776e183e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 3264396aada44ba89f39cfe0776e183e Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-739771398 Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 55b97e954da94f909f8f5ffff515509e Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeTestJSON-739771398-project Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.605079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': 'e625ca1a-4906-44bc-afe5-092b2f95c4d9'} Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:43.605847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. Sep 07 08:02:43.607393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:02:43.608857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] Returning 404 to user: Instance e625ca1a-4906-44bc-afe5-092b2f95c4d9 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:43.608857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9c1b09be-fa01-4b2c-9ac8-96c59befb73b tempest-AttachVolumeTestJSON-739771398 tempest-AttachVolumeTestJSON-739771398-project] 10.222.0.26 "GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9" status: 404 len: 111 microversion: 2.1 time: 0.033247 Sep 07 08:02:43.608857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 459/943] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:43 2022] GET /compute/v2.1/servers/e625ca1a-4906-44bc-afe5-092b2f95c4d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:02:43.843891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:43.844725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:43.851226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:43.851795 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:43.852333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:43.853297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:43.853962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:43.854399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:43.997055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:44.005560 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-299f73d6-c22f-40f1-947f-4a89ddd79598 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.166558 Sep 07 08:02:44.006605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 485/944] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:43 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:45.044294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:45.044294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:45.044294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:45.044294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:45.045109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:45.045109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:45.045109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:45.045109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:45.277555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:45.285518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-211e94d3-8a23-4ff8-9527-1f0a84d9f03a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.258503 Sep 07 08:02:45.286089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 460/945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:45 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:46.318349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:46.318976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:46.332698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-31026971-cdaa-45a1-801a-5ed2b5276a78 req-efa421cf-c04e-4df4-b013-2386a322e78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0154cd6-db30-423b-b2b1-2474366af3ad", "name": "network-vif-plugged", "status": "completed", "tag": "de9f20c3-f8c8-4d3e-bdba-7abd3d66ec62"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:46.342319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:46.342779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:46.343235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:46.343951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:46.346616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:46.347069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:46.376018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-31026971-cdaa-45a1-801a-5ed2b5276a78 req-efa421cf-c04e-4df4-b013-2386a322e78e service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:46.379442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-31026971-cdaa-45a1-801a-5ed2b5276a78 req-efa421cf-c04e-4df4-b013-2386a322e78e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:46.386051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-31026971-cdaa-45a1-801a-5ed2b5276a78 req-efa421cf-c04e-4df4-b013-2386a322e78e service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:46.430852 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-31026971-cdaa-45a1-801a-5ed2b5276a78 req-efa421cf-c04e-4df4-b013-2386a322e78e service nova] Creating event network-vif-plugged:de9f20c3-f8c8-4d3e-bdba-7abd3d66ec62 for instance d0154cd6-db30-423b-b2b1-2474366af3ad on hv-cinder-83602 Sep 07 08:02:46.459372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-31026971-cdaa-45a1-801a-5ed2b5276a78 req-efa421cf-c04e-4df4-b013-2386a322e78e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138114 Sep 07 08:02:46.473458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 461/946] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:02:46.724658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:46.742169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50931fa2-676b-4d65-83d1-37192f865691 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.426107 Sep 07 08:02:46.743574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 486/947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:46 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:47.772411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:47.775354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:47.784457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:47.785037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:47.785695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:47.786498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:47.786957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:47.787380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:47.955308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:47.964407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-767db936-ffc5-4277-a1ec-5f6d9f283635 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1313 microversion: 2.1 time: 0.198051 Sep 07 08:02:47.965095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 462/948] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:47 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:48.989126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:48.990330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:48.996409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:48.996893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:48.997324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:48.998013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:48.998469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:48.998886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:49.139810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:49.149026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-827b36f4-5ce1-4b58-ad9f-1674640cefce tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1497 microversion: 2.1 time: 0.164072 Sep 07 08:02:49.149772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 487/949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:48 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:02:49.758495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:49.759040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:49.766184 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:49.766669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:49.767099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:49.767792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:49.768273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:49.768697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:49.797680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:02:49.878554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-78b41bbd-2930-4c93-a1f4-171ce90c47f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 204 len: 0 microversion: 2.1 time: 0.123541 Sep 07 08:02:49.879271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 463/950] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:02:49 2022] DELETE /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:02:49.888408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:49.889165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:49.895700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:49.896783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:49.897218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:49.898340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:49.899984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:49.900467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:50.040934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:50.050942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6129f235-dd1e-4bae-99f2-6b72f5f4cee8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1503 microversion: 2.1 time: 0.167040 Sep 07 08:02:50.051474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 488/951] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:49 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:51.078903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:51.079610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:51.087012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:51.087613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:51.088132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:51.088993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:51.089527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:51.089971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:51.238032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:51.245882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fc85daea-961b-47e0-bd19-bfb5a62a47a2 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1503 microversion: 2.1 time: 0.171963 Sep 07 08:02:51.246443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 464/952] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:51 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:52.199101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-117cb353-5e43-42cd-aed0-4fd3ef626856 req-9e1f7f69-4640-43af-80b0-e4c502baeb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0154cd6-db30-423b-b2b1-2474366af3ad", "name": "network-vif-deleted", "tag": "de9f20c3-f8c8-4d3e-bdba-7abd3d66ec62"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:52.210544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-117cb353-5e43-42cd-aed0-4fd3ef626856 req-9e1f7f69-4640-43af-80b0-e4c502baeb39 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:52.217344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-117cb353-5e43-42cd-aed0-4fd3ef626856 req-9e1f7f69-4640-43af-80b0-e4c502baeb39 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:52.217925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-117cb353-5e43-42cd-aed0-4fd3ef626856 req-9e1f7f69-4640-43af-80b0-e4c502baeb39 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:52.235686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-117cb353-5e43-42cd-aed0-4fd3ef626856 req-9e1f7f69-4640-43af-80b0-e4c502baeb39 service nova] Creating event network-vif-deleted:de9f20c3-f8c8-4d3e-bdba-7abd3d66ec62 for instance d0154cd6-db30-423b-b2b1-2474366af3ad on hv-cinder-83602 Sep 07 08:02:52.243357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-117cb353-5e43-42cd-aed0-4fd3ef626856 req-9e1f7f69-4640-43af-80b0-e4c502baeb39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047820 Sep 07 08:02:52.244429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 489/953] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:52.270281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:52.272159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:52.283057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:52.284064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:52.284700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:52.285660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:52.286391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:52.286991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:52.379265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:52.389058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-582e6742-90f4-4772-b2ca-d9112b0f6d31 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 200 len: 1298 microversion: 2.1 time: 0.121969 Sep 07 08:02:52.390108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 465/954] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:52 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:53.414270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:53.415560 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: d0154cd6-db30-423b-b2b1-2474366af3ad] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:53.423040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:53.423722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:53.424373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:53.425242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:53.425853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:53.426430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:53.441613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] HTTP exception thrown: Instance d0154cd6-db30-423b-b2b1-2474366af3ad could not be found. Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Request method failure captured: Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad HTTP/1.1 Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGFAW4ZPX8tN7e3vyrVZjIpu-Yok9yXywn1wGNM34YA20oK-FXBThHEnSS6gXmoxGYXZwTsR3-aigYH01a0qojhVqVX7GgicW-G6Wa5fiWGTKnc4gIY1za5jWfGYUNTStLAXHVIHQQ4Mo8cB4hUuvVdfB29ZEjoalaYdJQ8hcTkeYEZo Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: b7f7a616ffc84d23af3691a2672a6829 Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesActionsTest-1804010501 Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:02:53.443252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7f7a616ffc84d23af3691a2672a6829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7f7a616ffc84d23af3691a2672a6829", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7f7a616ffc84d23af3691a2672a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7f7a616ffc84d23af3691a2672a6829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesActionsTest-1804010501 Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: b7f7a616ffc84d23af3691a2672a6829 Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesActionsTest-1804010501 Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesActionsTest-1804010501-project Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 7a67efdb6af84cfb92df1be6d8345ea9 Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesActionsTest-1804010501-project Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance d0154cd6-db30-423b-b2b1-2474366af3ad could not be found. Sep 07 08:02:53.444929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': 'd0154cd6-db30-423b-b2b1-2474366af3ad'} Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0154cd6-db30-423b-b2b1-2474366af3ad could not be found. Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:02:53.446049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0154cd6-db30-423b-b2b1-2474366af3ad could not be found. Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0154cd6-db30-423b-b2b1-2474366af3ad could not be found. Sep 07 08:02:53.447517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:02:53.449504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Returning 404 to user: Instance d0154cd6-db30-423b-b2b1-2474366af3ad could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:02:53.450663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9138228-3429-43c5-93b5-4d81af2a4839 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad" status: 404 len: 111 microversion: 2.1 time: 0.040995 Sep 07 08:02:53.451368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 490/955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:53 2022] GET /compute/v2.1/servers/d0154cd6-db30-423b-b2b1-2474366af3ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:02:53.616541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-628948524", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "networks": [{"uuid": "c5b37a94-5dcd-46a4-ae87-43012d4ab2c7"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:53.698302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] validate_networks() for [('c5b37a94-5dcd-46a4-ae87-43012d4ab2c7', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:02:54.141062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:02:54.141484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:02:54.141956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:02:54.142401 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:02:54.142813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:02:54.151569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:54.152042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:54.152505 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:54.153222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:54.153676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:54.154115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:54.170540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Getting quotas for project b7f7a616ffc84d23af3691a2672a6829. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:02:54.174383 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Getting quotas for user 7a67efdb6af84cfb92df1be6d8345ea9 and project b7f7a616ffc84d23af3691a2672a6829. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:02:54.185648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:02:54.188192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:02:54.233043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8b3287fc-5309-42ce-98fa-61a7af3f940e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624865 Sep 07 08:02:54.233677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 466/956] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:02:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 08:02:54.244809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e3fa2a5-69c9-4aeb-b2a5-19452e9a35d8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:54.245418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e3fa2a5-69c9-4aeb-b2a5-19452e9a35d8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:54.299501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e3fa2a5-69c9-4aeb-b2a5-19452e9a35d8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:54.306353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e3fa2a5-69c9-4aeb-b2a5-19452e9a35d8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1213 microversion: 2.1 time: 0.065392 Sep 07 08:02:54.306910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 491/957] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:54 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:55.330613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:55.331342 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:55.337370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:55.337860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:55.338289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:55.339183 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:55.339638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:55.340060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:55.409244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:55.424099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-098f1756-12f9-473c-8b24-44d675cbdc4e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1265 microversion: 2.1 time: 0.098247 Sep 07 08:02:55.424675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 467/958] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:55 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:56.451801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:56.452536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:56.459868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:56.460453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:56.461132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:56.461904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:56.462425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:56.462930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:56.615822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:56.624364 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e904f8e7-42c6-4b3c-96a8-0218d0a85a3e tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1313 microversion: 2.1 time: 0.177930 Sep 07 08:02:56.625326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 492/959] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:56 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:56.874719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-8c1d515d-31dc-499b-80a0-e4f0281e033c req-600e0d0d-cb4d-4601-9064-b66b6409d4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e77e95-087b-462b-92b4-c5b6b07bf442", "tag": "4448489e-d8ba-433c-8baf-6448eb733105"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:02:56.885003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8c1d515d-31dc-499b-80a0-e4f0281e033c req-600e0d0d-cb4d-4601-9064-b66b6409d4c8 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:56.885192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8c1d515d-31dc-499b-80a0-e4f0281e033c req-600e0d0d-cb4d-4601-9064-b66b6409d4c8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:56.886049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8c1d515d-31dc-499b-80a0-e4f0281e033c req-600e0d0d-cb4d-4601-9064-b66b6409d4c8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:56.891399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:02:56.900772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-8c1d515d-31dc-499b-80a0-e4f0281e033c req-600e0d0d-cb4d-4601-9064-b66b6409d4c8 service nova] Creating event network-changed:4448489e-d8ba-433c-8baf-6448eb733105 for instance 59e77e95-087b-462b-92b4-c5b6b07bf442 on hv-cinder-83602 Sep 07 08:02:56.907912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-8c1d515d-31dc-499b-80a0-e4f0281e033c req-600e0d0d-cb4d-4601-9064-b66b6409d4c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039228 Sep 07 08:02:56.908541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 468/960] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:02:57.647846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:57.648487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:57.655688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:57.656536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:57.656974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:57.657838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:57.658465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:57.659033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:57.815297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:57.823717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2875f33a-1fb8-4354-b57f-5002d6cb0fdb tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1313 microversion: 2.1 time: 0.179974 Sep 07 08:02:57.825315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 493/961] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:57 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:02:58.849249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:02:58.850030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:02:58.856510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:58.857021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:58.857455 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:58.858248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:02:58.858705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:02:58.859127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:02:58.997447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:02:59.005526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-88f3a403-3d78-4851-9d31-685e48264bac tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1313 microversion: 2.1 time: 0.161841 Sep 07 08:02:59.006257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 469/962] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:02:58 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:00.029421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:00.030125 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:00.036897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:00.037048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:00.037992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:00.038748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:00.039271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:00.039741 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:00.191995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:00.200268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f23228ed-6be9-4a21-9c55-4af8dd271ce3 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1313 microversion: 2.1 time: 0.175773 Sep 07 08:03:00.201798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 494/963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:00 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:03:01.225377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:01.225995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:01.233771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:01.234247 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:01.234683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:01.235416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:01.235876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:01.236335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:01.373892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:01.386647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fe60c6ff-041c-4d12-aaf7-d79d32981f70 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1313 microversion: 2.1 time: 0.164733 Sep 07 08:03:01.386798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 470/964] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:01 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:02.308884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-5eec9982-bef9-45e4-8ce1-6df166f4c95e req-dc0091a5-6af0-4d7e-bd37-86f2223edc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e77e95-087b-462b-92b4-c5b6b07bf442", "name": "network-vif-plugged", "status": "completed", "tag": "4448489e-d8ba-433c-8baf-6448eb733105"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:02.320243 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5eec9982-bef9-45e4-8ce1-6df166f4c95e req-dc0091a5-6af0-4d7e-bd37-86f2223edc00 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:02.321176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5eec9982-bef9-45e4-8ce1-6df166f4c95e req-dc0091a5-6af0-4d7e-bd37-86f2223edc00 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:02.321805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-5eec9982-bef9-45e4-8ce1-6df166f4c95e req-dc0091a5-6af0-4d7e-bd37-86f2223edc00 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:02.339045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-5eec9982-bef9-45e4-8ce1-6df166f4c95e req-dc0091a5-6af0-4d7e-bd37-86f2223edc00 service nova] Creating event network-vif-plugged:4448489e-d8ba-433c-8baf-6448eb733105 for instance 59e77e95-087b-462b-92b4-c5b6b07bf442 on hv-cinder-83602 Sep 07 08:03:02.345502 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-5eec9982-bef9-45e4-8ce1-6df166f4c95e req-dc0091a5-6af0-4d7e-bd37-86f2223edc00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Sep 07 08:03:02.347011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 495/965] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:03:02.410053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:02.411203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:02.418935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:02.420818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:02.421480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:02.422410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:02.423101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:02.423536 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:02.687187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:02.699454 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7b471133-38bc-45e2-aa22-a57895f113f8 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1313 microversion: 2.1 time: 0.293379 Sep 07 08:03:02.700024 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 471/966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:02 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:03.530010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-1a4799e9-525b-4172-baaa-ed98a17b6cd1 req-4253679e-7900-44a7-90af-5c0d8eae64e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a500c169-e521-4f76-b825-f3c52a0583fb", "tag": "ccdaaab5-715d-42e0-bff3-ea1b67a8f356"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:03.532233 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:03.535422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:03.548661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:03.549279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:03.551394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-1a4799e9-525b-4172-baaa-ed98a17b6cd1 req-4253679e-7900-44a7-90af-5c0d8eae64e6 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:03.551922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:03.552902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:03.553499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:03.554136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-1a4799e9-525b-4172-baaa-ed98a17b6cd1 req-4253679e-7900-44a7-90af-5c0d8eae64e6 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:03.554793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:03.555745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-1a4799e9-525b-4172-baaa-ed98a17b6cd1 req-4253679e-7900-44a7-90af-5c0d8eae64e6 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:03.585609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-1a4799e9-525b-4172-baaa-ed98a17b6cd1 req-4253679e-7900-44a7-90af-5c0d8eae64e6 service nova] Creating event network-changed:ccdaaab5-715d-42e0-bff3-ea1b67a8f356 for instance a500c169-e521-4f76-b825-f3c52a0583fb on hv-cinder-83602 Sep 07 08:03:03.593421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-1a4799e9-525b-4172-baaa-ed98a17b6cd1 req-4253679e-7900-44a7-90af-5c0d8eae64e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070809 Sep 07 08:03:03.594647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 472/967] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:03:03.609815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:03:03.723342 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:03.724137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:03.731247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d38e08d6-8f67-4649-8858-8219a9259066 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 204 len: 0 microversion: 2.1 time: 0.209711 Sep 07 08:03:03.733612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:03.734067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 496/968] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:03:03 2022] DELETE /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:03:03.734808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:03.735495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:03.736532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:03.742573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:03.742909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:03.743468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:03.745444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:03.770240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:03.771060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:03.771707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:03.773352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:03.773890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:03.774381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:03.944466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:03.964635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-21367fad-2e06-4dc5-b779-756ecf82f75f tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.224976 Sep 07 08:03:03.968814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 497/969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:03 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:03:03.995937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:04.004762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cd8cc90b-1a6e-4ef4-9dd5-a6cf8834254a tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1313 microversion: 2.1 time: 0.286195 Sep 07 08:03:04.005577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 473/970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:03 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:03:04.997913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:04.999400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:05.003707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:05.011161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:05.012022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:05.012911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:05.014042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:05.014677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:05.015464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:05.036275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:05.038280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:05.043328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:05.044813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:05.065850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:05.066348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:05.070137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:05.071083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:05.071816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:05.073691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:05.197961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:05.208063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0762b0b-5084-4a6d-af97-791ff9120c20 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.220268 Sep 07 08:03:05.212871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 498/971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:04 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:03:05.330452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:05.330452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a6147a37-a0cd-43c3-8fdd-e81b7351237f tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1498 microversion: 2.1 time: 0.302401 Sep 07 08:03:05.330452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 474/972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:05 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1498 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:06.012064 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:06.013439 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:06.020273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:06.020763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:06.021193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:06.021886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:06.022341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:06.024638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:06.056843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:03:06.086375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:06.151897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-65c718e6-f2c9-4f42-bd67-ce2ce6e328d1 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 204 len: 0 microversion: 2.1 time: 0.143650 Sep 07 08:03:06.152848 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 499/973] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:03:06 2022] DELETE /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:03:06.161771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:06.162434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:06.169997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:06.170490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:06.170924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:06.171622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:06.172094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:06.172541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:06.236765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:06.237468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:06.244642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:06.245151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:06.245584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:06.246282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:06.246929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:06.248052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:06.437783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:06.449647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-83e6c07b-d5f1-4f70-9cee-711782b03440 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1568 microversion: 2.1 time: 0.217852 Sep 07 08:03:06.451610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 500/974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:06 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:03:06.476535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:06.486474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e9719be8-52fd-4817-96f0-8c2acda0b01c tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1504 microversion: 2.1 time: 0.328698 Sep 07 08:03:06.487883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 475/975] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:06 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:06.735623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f2e3b854-208f-4d6a-84a1-cc486f199fe6 req-af21d646-5794-431a-9679-2897625f7fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a500c169-e521-4f76-b825-f3c52a0583fb", "name": "network-vif-deleted", "tag": "ccdaaab5-715d-42e0-bff3-ea1b67a8f356"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:06.746475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f2e3b854-208f-4d6a-84a1-cc486f199fe6 req-af21d646-5794-431a-9679-2897625f7fd0 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:06.747972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f2e3b854-208f-4d6a-84a1-cc486f199fe6 req-af21d646-5794-431a-9679-2897625f7fd0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:06.748578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f2e3b854-208f-4d6a-84a1-cc486f199fe6 req-af21d646-5794-431a-9679-2897625f7fd0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:06.763854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f2e3b854-208f-4d6a-84a1-cc486f199fe6 req-af21d646-5794-431a-9679-2897625f7fd0 service nova] Creating event network-vif-deleted:ccdaaab5-715d-42e0-bff3-ea1b67a8f356 for instance a500c169-e521-4f76-b825-f3c52a0583fb on hv-cinder-83602 Sep 07 08:03:06.771436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f2e3b854-208f-4d6a-84a1-cc486f199fe6 req-af21d646-5794-431a-9679-2897625f7fd0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040194 Sep 07 08:03:06.772801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 501/976] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:03:07.479516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:07.480630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:07.488935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:07.489616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:07.490263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:07.491278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:07.491915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:07.492582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:07.511392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:07.512117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:07.521460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:07.521948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:07.522686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:07.523571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:07.524237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:07.525242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:07.576485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:07.596447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8d205748-3228-4196-8aba-346285f4b224 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1219 microversion: 2.1 time: 0.124782 Sep 07 08:03:07.597002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 476/977] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:07 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:07.707640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:07.715410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-00dc5846-70cd-419a-ae0a-fdf56f841284 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1504 microversion: 2.1 time: 0.208487 Sep 07 08:03:07.716918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 502/978] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:07 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:08.620458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:08.620918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:08.630354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:08.630847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:08.631285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:08.636714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:08.640761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:08.642323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:08.680634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:08.681564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:08.682367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:08.682891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lazy-loading 'fault' on Instance uuid a500c169-e521-4f76-b825-f3c52a0583fb {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:03:08.743063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:08.749011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad6564a2e9a43c2bdb0358622ff3415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d04fe2eaaf43fc82d82f344faea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:08.755539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:08.766288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8bace7f7-a791-49b2-8a34-d56651f40380 tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 200 len: 1342 microversion: 2.1 time: 0.150792 Sep 07 08:03:08.767702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 477/979] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:08 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:08.781445 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:08.782444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:08.782947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:08.784023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:08.784642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:08.785536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:08.803511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-d205715b-ff10-43a5-97f8-1781ee65b1b8 req-34616a97-1eb6-4547-ad9f-915369c9f5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e77e95-087b-462b-92b4-c5b6b07bf442", "name": "network-vif-deleted", "tag": "4448489e-d8ba-433c-8baf-6448eb733105"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:08.815809 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d205715b-ff10-43a5-97f8-1781ee65b1b8 req-34616a97-1eb6-4547-ad9f-915369c9f5c8 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:08.816473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d205715b-ff10-43a5-97f8-1781ee65b1b8 req-34616a97-1eb6-4547-ad9f-915369c9f5c8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:08.816964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d205715b-ff10-43a5-97f8-1781ee65b1b8 req-34616a97-1eb6-4547-ad9f-915369c9f5c8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:08.829289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-d205715b-ff10-43a5-97f8-1781ee65b1b8 req-34616a97-1eb6-4547-ad9f-915369c9f5c8 service nova] Creating event network-vif-deleted:4448489e-d8ba-433c-8baf-6448eb733105 for instance 59e77e95-087b-462b-92b4-c5b6b07bf442 on hv-cinder-83602 Sep 07 08:03:08.834043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-d205715b-ff10-43a5-97f8-1781ee65b1b8 req-34616a97-1eb6-4547-ad9f-915369c9f5c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040391 Sep 07 08:03:08.834631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 478/980] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:03:08.835267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:08.835818 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:08.836487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:08.837204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lazy-loading 'fault' on Instance uuid 59e77e95-087b-462b-92b4-c5b6b07bf442 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:03:08.884874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a67efdb6af84cfb92df1be6d8345ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f7a616ffc84d23af3691a2672a6829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:08.892930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-750b7db8-d58b-4202-b94f-4f01fc0fc6dd tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 200 len: 1303 microversion: 2.1 time: 0.157453 Sep 07 08:03:08.893497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 503/981] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:08 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:09.793501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:09.794883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] [instance: a500c169-e521-4f76-b825-f3c52a0583fb] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:09.801986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:09.802724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:09.803331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:09.804225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:09.804896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:09.805492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:09.821059 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] HTTP exception thrown: Instance a500c169-e521-4f76-b825-f3c52a0583fb could not be found. Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Request method failure captured: Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb HTTP/1.1 Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGE7sF_aCO3T7_xa9gfvHGhYHUEyO7viXxJA4fijIXMnCtrX8EqaLCN6CZMc9zUSA-ii7SN5VTvMsVGh5sGuTLRmJ4JRM0c4_H9DU50hz51eiL5jIdWFuRdx506GZUYpNr7Gs0oHWxfHJINuIShth1S1fjZG0JcjBWHqK41o7eGJWJkk Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 53d04fe2eaaf43fc82d82f344faea612 Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-TestShelveInstance-1506849891 Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:03:09.822727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53d04fe2eaaf43fc82d82f344faea612"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_53d04fe2eaaf43fc82d82f344faea612", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53d04fe2eaaf43fc82d82f344faea612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/53d04fe2eaaf43fc82d82f344faea612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-TestShelveInstance-1506849891 Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 53d04fe2eaaf43fc82d82f344faea612 Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-TestShelveInstance-1506849891 Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-TestShelveInstance-1506849891-project Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 8ad6564a2e9a43c2bdb0358622ff3415 Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-TestShelveInstance-1506849891-project Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance a500c169-e521-4f76-b825-f3c52a0583fb could not be found. Sep 07 08:03:09.824231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': 'a500c169-e521-4f76-b825-f3c52a0583fb'} Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a500c169-e521-4f76-b825-f3c52a0583fb could not be found. Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:03:09.825105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a500c169-e521-4f76-b825-f3c52a0583fb could not be found. Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a500c169-e521-4f76-b825-f3c52a0583fb could not be found. Sep 07 08:03:09.827166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.828620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Returning 404 to user: Instance a500c169-e521-4f76-b825-f3c52a0583fb could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:03:09.828620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-30102fb4-e235-403c-bdb0-460bd4b7a06c tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb" status: 404 len: 111 microversion: 2.1 time: 0.035253 Sep 07 08:03:09.828620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 479/982] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:09 2022] GET /compute/v2.1/servers/a500c169-e521-4f76-b825-f3c52a0583fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:03:09.921252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:09.921855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] [instance: 59e77e95-087b-462b-92b4-c5b6b07bf442] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:09.928561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:09.929045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:09.929484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:09.930166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:09.930615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:09.931036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:09.945612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.wsgi [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] HTTP exception thrown: Instance 59e77e95-087b-462b-92b4-c5b6b07bf442 could not be found. Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Request method failure captured: Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: request: GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 HTTP/1.1 Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept: application/json Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Accept-Encoding: identity Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Connection: close Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Length: 0 Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Content-Type: application/json Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Host: 10.222.0.26 Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Openstack-System-Scope: None Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: User-Agent: python-urllib3/1.26.12 Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Auth-Token: gAAAAABjGFAW4ZPX8tN7e3vyrVZjIpu-Yok9yXywn1wGNM34YA20oK-FXBThHEnSS6gXmoxGYXZwTsR3-aigYH01a0qojhVqVX7GgicW-G6Wa5fiWGTKnc4gIY1za5jWfGYUNTStLAXHVIHQQ4Mo8cB4hUuvVdfB29ZEjoalaYdJQ8hcTkeYEZo Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Id: None Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Domain-Name: None Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Identity-Status: Confirmed Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Is-Admin-Project: True Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Id: default Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Domain-Name: Default Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Id: b7f7a616ffc84d23af3691a2672a6829 Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Project-Name: tempest-VolumesActionsTest-1804010501 Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Role: reader,member Sep 07 08:03:09.947327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Roles: reader,member Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7f7a616ffc84d23af3691a2672a6829"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7f7a616ffc84d23af3691a2672a6829", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7f7a616ffc84d23af3691a2672a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7f7a616ffc84d23af3691a2672a6829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant: tempest-VolumesActionsTest-1804010501 Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Id: b7f7a616ffc84d23af3691a2672a6829 Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-Tenant-Name: tempest-VolumesActionsTest-1804010501 Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User: tempest-VolumesActionsTest-1804010501-project Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Id: default Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Domain-Name: Default Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Id: 7a67efdb6af84cfb92df1be6d8345ea9 Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: X-User-Name: tempest-VolumesActionsTest-1804010501-project Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: method: > Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: exception: Instance 59e77e95-087b-462b-92b4-c5b6b07bf442 could not be found. Sep 07 08:03:09.949016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: action_args: {'id': '59e77e95-087b-462b-92b4-c5b6b07bf442'} Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e77e95-087b-462b-92b4-c5b6b07bf442 could not be found. Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:03:09.949814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e77e95-087b-462b-92b4-c5b6b07bf442 could not be found. Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e77e95-087b-462b-92b4-c5b6b07bf442 could not be found. Sep 07 08:03:09.952927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR nova.api.openstack.wsgi Sep 07 08:03:09.955238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] Returning 404 to user: Instance 59e77e95-087b-462b-92b4-c5b6b07bf442 could not be found. {{(pid=120494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:03:09.955238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a6a032ab-cc85-409b-b286-cffdb98529d0 tempest-VolumesActionsTest-1804010501 tempest-VolumesActionsTest-1804010501-project] 10.222.0.26 "GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442" status: 404 len: 111 microversion: 2.1 time: 0.031869 Sep 07 08:03:09.955238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 504/983] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:09 2022] GET /compute/v2.1/servers/59e77e95-087b-462b-92b4-c5b6b07bf442 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:03:10.019428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c49c2d12-62f2-41af-9d4c-12f5e2bdbaed tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] Calling method '.version_select at 0x7f831e92ea60>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:10.028569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:10.056347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c49c2d12-62f2-41af-9d4c-12f5e2bdbaed tempest-TestShelveInstance-1506849891 tempest-TestShelveInstance-1506849891-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-629093183" status: 202 len: 0 microversion: 2.1 time: 0.042948 Sep 07 08:03:10.057384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 480/984] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 7 08:03:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-629093183 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:03:46.998710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-152815481", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "networks": [{"uuid": "0c5879c8-1077-45ce-bda4-0b881370d58b"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:47.007600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:47.008470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:47.059452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] validate_networks() for [('0c5879c8-1077-45ce-bda4-0b881370d58b', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:03:47.406076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:03:47.406503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:03:47.406982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:03:47.407394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:03:47.407808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:03:47.416648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:47.417135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:47.418103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:47.418835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:47.419291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:47.419718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:47.438236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Getting quotas for project 0f785182c7d64af5ab5d37a4b95275b9. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:03:47.442091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Getting quotas for user aef73a49de304706a59335eff37debf0 and project 0f785182c7d64af5ab5d37a4b95275b9. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:03:47.453114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:03:47.455385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:03:47.498981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d2511452-f1df-4082-8e6e-ca617ae66667 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504637 Sep 07 08:03:47.499619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 505/985] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 08:03:47.511050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0f40263d-930e-45a8-887b-d8e0c56e3929 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:47.511838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0f40263d-930e-45a8-887b-d8e0c56e3929 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:47.514090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=57 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:47.571927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0f40263d-930e-45a8-887b-d8e0c56e3929 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:47.579002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0f40263d-930e-45a8-887b-d8e0c56e3929 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1218 microversion: 2.1 time: 0.072172 Sep 07 08:03:47.579563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 481/986] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:47 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:48.602195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:48.602792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:48.609710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:48.610194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:48.610623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:48.611314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:48.611764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:48.612213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:48.678912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:48.688234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66f25556-8aac-4cea-bc8b-6ccb2dcb7ac1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1278 microversion: 2.1 time: 0.090416 Sep 07 08:03:48.688900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 506/987] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:48 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:49.712227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:49.712839 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:49.720871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:49.721361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:49.721800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:49.722494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:49.722946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:49.723370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:49.932378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:49.944862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ab48b2b6-b839-4b92-8473-19344b88d41b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1318 microversion: 2.1 time: 0.236336 Sep 07 08:03:49.945546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 482/988] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:49 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:50.077545 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-d547b83d-26c1-41c9-a24f-af3ac78f9b00 req-fb9d890c-0b81-4a8c-a230-5df7c89a48e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b191c3d-dc29-4edb-91c7-e77bbecb69ac", "tag": "ed00be80-8ab1-496a-aeb6-8b53558141d0"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:50.089267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d547b83d-26c1-41c9-a24f-af3ac78f9b00 req-fb9d890c-0b81-4a8c-a230-5df7c89a48e0 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:50.089824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d547b83d-26c1-41c9-a24f-af3ac78f9b00 req-fb9d890c-0b81-4a8c-a230-5df7c89a48e0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:50.091031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-d547b83d-26c1-41c9-a24f-af3ac78f9b00 req-fb9d890c-0b81-4a8c-a230-5df7c89a48e0 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:50.103990 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-d547b83d-26c1-41c9-a24f-af3ac78f9b00 req-fb9d890c-0b81-4a8c-a230-5df7c89a48e0 service nova] Creating event network-changed:ed00be80-8ab1-496a-aeb6-8b53558141d0 for instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac on hv-cinder-83602 Sep 07 08:03:50.109761 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-d547b83d-26c1-41c9-a24f-af3ac78f9b00 req-fb9d890c-0b81-4a8c-a230-5df7c89a48e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039037 Sep 07 08:03:50.110507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 507/989] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:03:50.968928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:50.969542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:50.975889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:50.976405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:50.976846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:50.977539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:50.977993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:50.978440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:51.124447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:51.135791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b6afadb-9c54-456a-9cb3-14105a5cef25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1318 microversion: 2.1 time: 0.170403 Sep 07 08:03:51.136689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 483/990] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:50 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:52.159151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:52.159876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:52.166489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:52.166966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:52.167431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:52.168232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:52.168689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:52.169111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:52.532100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:52.539619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e5562654-3eeb-44aa-858c-3ee03c2f7100 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1318 microversion: 2.1 time: 0.384680 Sep 07 08:03:52.540199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 508/991] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:52 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:03:52.670317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1602544234", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:52.721718 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] validate_networks() for None {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:03:52.988984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:03:52.989411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:03:52.989908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:03:52.990323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:03:52.990734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:03:52.999736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:53.000254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:53.000690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:53.001413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:53.001868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:53.002289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:53.018594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Getting quotas for project db894a1c343942e3be94240770b3a265. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:03:53.022464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Getting quotas for user 49e563c07fef402aa03183b3c6784c9e and project db894a1c343942e3be94240770b3a265. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:03:53.033720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:03:53.035938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:03:53.079925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-71553b7f-d736-4437-8907-6bd483fee86f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.414017 Sep 07 08:03:53.080927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 484/992] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:03:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 08:03:53.092378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50c69db0-d5a6-4cdd-8c65-7a2e6ec2e0ac tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:53.093001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50c69db0-d5a6-4cdd-8c65-7a2e6ec2e0ac tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:53.153337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-50c69db0-d5a6-4cdd-8c65-7a2e6ec2e0ac tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:53.160196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50c69db0-d5a6-4cdd-8c65-7a2e6ec2e0ac tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1215 microversion: 2.1 time: 0.072215 Sep 07 08:03:53.161089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 509/993] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:53 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:53.563848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:53.564386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:53.570398 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:53.570879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:53.571309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:53.572002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:53.572475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:53.572895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:53.955733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:53.963303 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d44cd17e-959f-44df-8925-98980ddd3006 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1318 microversion: 2.1 time: 0.403823 Sep 07 08:03:53.963897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 485/994] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:53 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:54.184194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:54.184854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:54.194793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:54.195279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:54.195710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:54.196435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:54.196890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:54.197313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:54.262494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:54.270381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2720811f-4cb9-41b3-b132-569f3c097a6f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1267 microversion: 2.1 time: 0.090850 Sep 07 08:03:54.270948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 510/995] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:54 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:54.987034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:54.987580 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:54.993635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:54.994127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:54.994592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:54.995274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:54.996638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:54.997079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:55.222961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:55.233835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ae17bf9d-d2e3-430b-bfb4-3a5a738d13a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1318 microversion: 2.1 time: 0.251198 Sep 07 08:03:55.249064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 486/996] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:54 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:55.295804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-8eae8827-1951-4129-92aa-0d44b0be376b req-91cca813-702a-4d8b-8173-f9ac25391d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b191c3d-dc29-4edb-91c7-e77bbecb69ac", "name": "network-vif-plugged", "status": "completed", "tag": "ed00be80-8ab1-496a-aeb6-8b53558141d0"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:55.312007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:55.312655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:55.317894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8eae8827-1951-4129-92aa-0d44b0be376b req-91cca813-702a-4d8b-8173-f9ac25391d23 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:55.318599 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8eae8827-1951-4129-92aa-0d44b0be376b req-91cca813-702a-4d8b-8173-f9ac25391d23 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:55.319209 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-8eae8827-1951-4129-92aa-0d44b0be376b req-91cca813-702a-4d8b-8173-f9ac25391d23 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:55.329192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:55.329918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:55.330563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:55.331443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:55.332068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:55.332668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:55.332852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-8eae8827-1951-4129-92aa-0d44b0be376b req-91cca813-702a-4d8b-8173-f9ac25391d23 service nova] Creating event network-vif-plugged:ed00be80-8ab1-496a-aeb6-8b53558141d0 for instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac on hv-cinder-83602 Sep 07 08:03:55.346313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-8eae8827-1951-4129-92aa-0d44b0be376b req-91cca813-702a-4d8b-8173-f9ac25391d23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054813 Sep 07 08:03:55.347499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 511/997] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:03:55.629941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:55.637651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5c9b1bc8-4068-4f1e-9a03-06211782c2b6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.336770 Sep 07 08:03:55.638306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 487/998] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:55 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:56.049359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-6c715863-9d07-4489-a2e5-206c05117d19 req-4122b850-8f48-4dea-8b7b-7a56a90c95d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efe51ae-43ea-4d97-bcbe-fbbe0c059db3", "tag": "f4e5f419-26dd-465b-92b4-1b3308dcde4e"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:03:56.059604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c715863-9d07-4489-a2e5-206c05117d19 req-4122b850-8f48-4dea-8b7b-7a56a90c95d8 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:56.060113 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c715863-9d07-4489-a2e5-206c05117d19 req-4122b850-8f48-4dea-8b7b-7a56a90c95d8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:56.060724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-6c715863-9d07-4489-a2e5-206c05117d19 req-4122b850-8f48-4dea-8b7b-7a56a90c95d8 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:56.073442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-6c715863-9d07-4489-a2e5-206c05117d19 req-4122b850-8f48-4dea-8b7b-7a56a90c95d8 service nova] Creating event network-changed:f4e5f419-26dd-465b-92b4-1b3308dcde4e for instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 on hv-cinder-83602 Sep 07 08:03:56.078215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-6c715863-9d07-4489-a2e5-206c05117d19 req-4122b850-8f48-4dea-8b7b-7a56a90c95d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032896 Sep 07 08:03:56.078802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 512/999] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:03:56.257753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:56.258363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:56.265430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:56.265908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:56.266365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:56.267048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:56.267516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:56.267962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:56.396804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:56.405621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f505f2bd-2b21-4978-b50d-fe9e4b03d755 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1318 microversion: 2.1 time: 0.151598 Sep 07 08:03:56.406165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 488/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:56 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:56.661165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:56.661788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:56.668306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:56.668784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:56.669214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:56.669894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:56.670344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:56.670764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:56.814241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:56.821826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db229885-52db-45ea-8bc6-397daed50239 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.165429 Sep 07 08:03:56.822383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 513/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:56 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:57.428511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:57.429221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:57.435667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:57.436549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:57.437062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:57.437801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:57.438260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:57.438690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:57.642936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:57.650615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-191753d9-cc55-46c1-8ac9-068e6f0adb68 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1507 microversion: 2.1 time: 0.225958 Sep 07 08:03:57.651181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 489/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:57 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:57.845663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:57.846403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:57.849249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:03:57.853653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:57.854148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:57.854605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:57.855340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:57.855792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:57.856240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:57.989826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:57.998003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dc826f79-8152-4f0d-9414-1b2c59b64d35 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.156206 Sep 07 08:03:57.998581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 514/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:57 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:03:59.022788 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:03:59.023429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:03:59.030366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:59.030846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:59.031277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:59.031970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:03:59.032458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:03:59.032875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:03:59.166812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:03:59.175720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-81aa7766-7bd9-4c49-80a1-1912ded71e4f tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.157743 Sep 07 08:03:59.176317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 490/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:03:59 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:00.198765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:00.199474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:00.206051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:00.206540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:00.206980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:00.207687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:00.208166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:00.208594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:00.344595 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:00.352185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-192fbb7d-fef2-4395-a56a-94d9e99d8fb6 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.157346 Sep 07 08:04:00.352844 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 515/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:00 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:01.376133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:01.376734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:01.383358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:01.383844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:01.384326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:01.385258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:01.385460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:01.385878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:01.674218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:01.681820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5cef1987-71f9-4855-9cd5-282f38429cfc tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.310059 Sep 07 08:04:01.682376 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 491/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:01 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:02.705462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:02.706080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:02.712522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:02.713003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:02.713441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:02.714153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:02.714603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:02.715542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:02.848380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:02.857057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-193fdd82-cc1d-4fd7-a9a2-e22ace5b36aa tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.155399 Sep 07 08:04:02.857642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 516/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:02 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:03.433681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-fade4ae7-db00-4377-a84d-eae72c230f97 req-b8e9fd6a-1ba3-4933-878f-a8fd062109a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efe51ae-43ea-4d97-bcbe-fbbe0c059db3", "name": "network-vif-plugged", "status": "completed", "tag": "f4e5f419-26dd-465b-92b4-1b3308dcde4e"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:04:03.441826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:03.442563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=8 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:03.448845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-fade4ae7-db00-4377-a84d-eae72c230f97 req-b8e9fd6a-1ba3-4933-878f-a8fd062109a3 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:03.449329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-fade4ae7-db00-4377-a84d-eae72c230f97 req-b8e9fd6a-1ba3-4933-878f-a8fd062109a3 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:03.450726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-fade4ae7-db00-4377-a84d-eae72c230f97 req-b8e9fd6a-1ba3-4933-878f-a8fd062109a3 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:03.462649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-fade4ae7-db00-4377-a84d-eae72c230f97 req-b8e9fd6a-1ba3-4933-878f-a8fd062109a3 service nova] Creating event network-vif-plugged:f4e5f419-26dd-465b-92b4-1b3308dcde4e for instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 on hv-cinder-83602 Sep 07 08:04:03.468277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-fade4ae7-db00-4377-a84d-eae72c230f97 req-b8e9fd6a-1ba3-4933-878f-a8fd062109a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038709 Sep 07 08:04:03.469025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 492/1008] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:04:03.880826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:03.881432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:03.883256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=8 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:03.889742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:03.890257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:03.890802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:03.891543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:03.892070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:03.892549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:04.036339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:04.045538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-236e896b-9bc1-4c0b-bdb9-839fedbf8789 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1315 microversion: 2.1 time: 0.168546 Sep 07 08:04:04.046109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 517/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:03 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:05.070234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:05.071275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:05.079388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:05.079876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:05.080345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:05.081043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:05.081496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:05.081917 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:05.217397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:05.224926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bfec9d97-27d8-4cf2-8694-e909ea8149e4 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1464 microversion: 2.1 time: 0.159612 Sep 07 08:04:05.225470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 493/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:05 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:05.275739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:05.276335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:05.284765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:05.285250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:05.285883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:05.286592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:05.287043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:05.287464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:05.313327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:04:05.391020 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9e9e71e4-bafc-4a90-bbf1-bf8225c4d75d tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 204 len: 0 microversion: 2.1 time: 0.118994 Sep 07 08:04:05.391720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 518/1011] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:04:05 2022] DELETE /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:04:05.400386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:05.400989 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:05.407836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:05.408352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:05.408785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:05.409481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:05.409929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:05.410348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:05.541176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:05.548945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-20bb2d83-a4b2-4a07-996f-deb0834b1d0a tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1470 microversion: 2.1 time: 0.152539 Sep 07 08:04:05.549498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 494/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:05 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:06.573234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:06.573937 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:06.581176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:06.581674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:06.582111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:06.582829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:06.583344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:06.583776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:06.718526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:06.726327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c4e230d-c180-420c-8539-2378467f3955 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1470 microversion: 2.1 time: 0.157366 Sep 07 08:04:06.726923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 519/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:06 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:07.475538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6652c6b6-93e8-46c9-9f8b-74b755b7b2b6 req-d2612149-5849-45d7-8e51-60ae5b303108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efe51ae-43ea-4d97-bcbe-fbbe0c059db3", "name": "network-vif-deleted", "tag": "f4e5f419-26dd-465b-92b4-1b3308dcde4e"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:04:07.490810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6652c6b6-93e8-46c9-9f8b-74b755b7b2b6 req-d2612149-5849-45d7-8e51-60ae5b303108 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:07.491285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6652c6b6-93e8-46c9-9f8b-74b755b7b2b6 req-d2612149-5849-45d7-8e51-60ae5b303108 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:07.491707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6652c6b6-93e8-46c9-9f8b-74b755b7b2b6 req-d2612149-5849-45d7-8e51-60ae5b303108 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:07.510352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6652c6b6-93e8-46c9-9f8b-74b755b7b2b6 req-d2612149-5849-45d7-8e51-60ae5b303108 service nova] Creating event network-vif-deleted:f4e5f419-26dd-465b-92b4-1b3308dcde4e for instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 on hv-cinder-83602 Sep 07 08:04:07.516943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6652c6b6-93e8-46c9-9f8b-74b755b7b2b6 req-d2612149-5849-45d7-8e51-60ae5b303108 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045377 Sep 07 08:04:07.517558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 495/1014] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:04:07.755646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:07.755646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:07.762336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:07.763012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:07.763472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:07.764203 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:07.764673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:07.765105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:07.799344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:07.799836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:07.800306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:07.800765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.objects.instance [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lazy-loading 'fault' on Instance uuid 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 {{(pid=120494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:04:07.843109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e563c07fef402aa03183b3c6784c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db894a1c343942e3be94240770b3a265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:07.851794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-215e8e84-29c0-4898-84a7-e12b1ccfd530 tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 200 len: 1305 microversion: 2.1 time: 0.105483 Sep 07 08:04:07.852397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 520/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:07 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:08.877365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:08.878015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] [instance: 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:08.884332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:08.884825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:08.885265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:08.885962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:08.886422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:08.887568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:08.900680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] HTTP exception thrown: Instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 could not be found. Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Request method failure captured: Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 HTTP/1.1 Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGFBnzF91t_uq6Un4k0jhkqHXw6uEYpa31D5WcrD1d29OIC-4W3sc9Pm-Oz3_unH6x5UBMEbKWNgai0Fx3G1bB4CcBVGXQhuPvahUQvx_ghu5o-JGdoR_a86g06snHAb0UhwNviS8Q6kJkUg2FFTwsymUdk9u1Q4oqZmyJIO_JSIEWDA Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: db894a1c343942e3be94240770b3a265 Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesNegativeTest-1281974534 Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:04:08.902332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db894a1c343942e3be94240770b3a265"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_db894a1c343942e3be94240770b3a265", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/db894a1c343942e3be94240770b3a265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/db894a1c343942e3be94240770b3a265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesNegativeTest-1281974534 Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: db894a1c343942e3be94240770b3a265 Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesNegativeTest-1281974534 Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesNegativeTest-1281974534-project Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 49e563c07fef402aa03183b3c6784c9e Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesNegativeTest-1281974534-project Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 could not be found. Sep 07 08:04:08.904042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '9efe51ae-43ea-4d97-bcbe-fbbe0c059db3'} Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 could not be found. Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:04:08.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 could not be found. Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 could not be found. Sep 07 08:04:08.906785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:08.908328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] Returning 404 to user: Instance 9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:04:08.908328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-81024685-c694-40f4-a71e-6edc88c335fb tempest-VolumesNegativeTest-1281974534 tempest-VolumesNegativeTest-1281974534-project] 10.222.0.26 "GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3" status: 404 len: 111 microversion: 2.1 time: 0.031676 Sep 07 08:04:08.908328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 496/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:08 2022] GET /compute/v2.1/servers/9efe51ae-43ea-4d97-bcbe-fbbe0c059db3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:04:12.893893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02d8283e-0175-4160-9123-2aa8eff5712b", "device": "/dev/sdb"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:04:12.896767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:12.903816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:12.904326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:12.904770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:12.905468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:12.905955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:12.906417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:13.169459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:13.179959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4da8d2a9-2398-4887-bf48-c245a7f94d53 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "POST /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289914 Sep 07 08:04:13.180616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 521/1017] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 08:04:12 2022] POST /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:04:42.234248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:42.234816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:42.240865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:42.242228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=74 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:42.243983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:42.244998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:42.246384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:42.247299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:42.248118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:42.248706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:42.345210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lazy-loading 'services' on Instance uuid 6b191c3d-dc29-4edb-91c7-e77bbecb69ac {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:04:42.441321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1f0ea15e-31d5-4951-9fb8-f667d1967683 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac/os-volume_attachments/02d8283e-0175-4160-9123-2aa8eff5712b" status: 202 len: 0 microversion: 2.1 time: 0.210727 Sep 07 08:04:42.442065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 497/1018] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 08:04:42 2022] DELETE /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac/os-volume_attachments/02d8283e-0175-4160-9123-2aa8eff5712b => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:04:43.638924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:43.640243 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:43.651141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:43.654148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:43.654878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:43.655818 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:43.657136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:43.657758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:43.658375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:43.705365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:04:43.850057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db1ac3ae-5d10-4605-b4ca-1d363d7c74f3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 204 len: 0 microversion: 2.1 time: 0.215553 Sep 07 08:04:43.851382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 522/1019] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:04:43 2022] DELETE /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:04:43.860609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:43.861309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:43.867757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:43.868287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:43.868723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:43.869461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:43.869888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:43.870404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:44.132474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:44.145176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8dd3781-c339-4350-9806-88a6c038fa42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1513 microversion: 2.1 time: 0.288699 Sep 07 08:04:44.160139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 498/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:43 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:45.178852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:45.180291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:45.200843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:45.202933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:45.204909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:45.206851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:45.209820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:45.210475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:45.441762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:45.450726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-386fec9b-e622-4df9-9aa1-03aebf8c771f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1513 microversion: 2.1 time: 0.279957 Sep 07 08:04:45.467448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 523/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:45 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:46.475741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:46.476628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:46.484284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:46.484779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:46.485216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:46.485915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:46.486373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:46.486798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:46.577426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:46.588304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aac4102e-bdc6-4d27-a24b-5a161f97e19f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 200 len: 1471 microversion: 2.1 time: 0.117458 Sep 07 08:04:46.588906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 499/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:46 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:46.597434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-1dcdfe51-883c-4dd1-9565-d8d560b322a6 req-8986770f-9017-4793-86cd-ec004fb85288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b191c3d-dc29-4edb-91c7-e77bbecb69ac", "name": "network-vif-deleted", "tag": "ed00be80-8ab1-496a-aeb6-8b53558141d0"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:04:46.608653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-1dcdfe51-883c-4dd1-9565-d8d560b322a6 req-8986770f-9017-4793-86cd-ec004fb85288 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:46.609361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-1dcdfe51-883c-4dd1-9565-d8d560b322a6 req-8986770f-9017-4793-86cd-ec004fb85288 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:46.609825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-1dcdfe51-883c-4dd1-9565-d8d560b322a6 req-8986770f-9017-4793-86cd-ec004fb85288 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:46.636168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-1dcdfe51-883c-4dd1-9565-d8d560b322a6 req-8986770f-9017-4793-86cd-ec004fb85288 service nova] Creating event network-vif-deleted:ed00be80-8ab1-496a-aeb6-8b53558141d0 for instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac on hv-cinder-83602 Sep 07 08:04:46.641830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-1dcdfe51-883c-4dd1-9565-d8d560b322a6 req-8986770f-9017-4793-86cd-ec004fb85288 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051079 Sep 07 08:04:46.642882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 500/1023] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:04:46.759041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb0f4e84-721a-40ec-b6f1-b914f1f15001 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Action: 'create', calling method: .version_select at 0x7f831edb7e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1041568426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOluXOCfmBsWwsu8hiFDzko7n8Zxt8Jbz2hIp4J7ydKC5dZaBLanam56bMuHaEuAC5/apJSskHiucgBu8mTt2/1VFLRyRw5Fzq4AlqbXfKjzRNy6kVVdlXR9B7dNk+eDYQ=="}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:04:46.779441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-bb0f4e84-721a-40ec-b6f1-b914f1f15001 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Getting quotas for project e2744f91a6284e0688af92a926c199d1. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:04:46.783909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-bb0f4e84-721a-40ec-b6f1-b914f1f15001 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Getting quotas for user 19af2d1084c14c3ea2df8369855aaed0 and project e2744f91a6284e0688af92a926c199d1. Resources: {'key_pairs'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:04:46.809063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb0f4e84-721a-40ec-b6f1-b914f1f15001 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.281566 Sep 07 08:04:46.809665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 524/1024] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 7 08:04:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:04:47.613200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:47.614056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: 6b191c3d-dc29-4edb-91c7-e77bbecb69ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:47.621527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:47.622016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:47.622461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:47.623161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:47.623617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:47.624043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:47.639837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] HTTP exception thrown: Instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac could not be found. Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Request method failure captured: Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac HTTP/1.1 Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGFBhx1CIcvY99kVPKTZC1nhSTRiW8WmbGxjG9mJE1T9N41X91ty8P8jJ8fmKpGkecqcRjvfbzNOPxK8AQ6f5zjmEIkIKY9Bk7AIY04-Q6euMkGZuIHLAA1hnbn5uLA0plip2CloNUZbZMTbmqd3ljPuYDhI0sA0hbB7MMKS4zpWZbY4 Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: 0f785182c7d64af5ab5d37a4b95275b9 Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1585193218 Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:04:47.641540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0f785182c7d64af5ab5d37a4b95275b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0f785182c7d64af5ab5d37a4b95275b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0f785182c7d64af5ab5d37a4b95275b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0f785182c7d64af5ab5d37a4b95275b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesSnapshotTestJSON-1585193218 Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 0f785182c7d64af5ab5d37a4b95275b9 Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1585193218 Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesSnapshotTestJSON-1585193218-project Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: aef73a49de304706a59335eff37debf0 Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesSnapshotTestJSON-1585193218-project Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac could not be found. Sep 07 08:04:47.643300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '6b191c3d-dc29-4edb-91c7-e77bbecb69ac'} Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac could not be found. Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:04:47.644309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac could not be found. Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac could not be found. Sep 07 08:04:47.645914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:04:47.647175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Returning 404 to user: Instance 6b191c3d-dc29-4edb-91c7-e77bbecb69ac could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:04:47.647175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83534fd0-0d89-438b-b0c4-321980b39114 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac" status: 404 len: 111 microversion: 2.1 time: 0.034509 Sep 07 08:04:47.647175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 501/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:47 2022] GET /compute/v2.1/servers/6b191c3d-dc29-4edb-91c7-e77bbecb69ac => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:04:55.565936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:55.570444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1434161161", "imageRef": "778b286a-9f4e-4c8e-9460-fe715f0e8fcb", "flavorRef": "452", "networks": [{"uuid": "0c5879c8-1077-45ce-bda4-0b881370d58b"}]}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:04:55.625615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.network.neutron [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] validate_networks() for [('0c5879c8-1077-45ce-bda4-0b881370d58b', None, None, None, None, None)] {{(pid=120494) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:04:55.991876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Flavor limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:04:55.992432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Image limits 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:04:55.992905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Flavor pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:04:55.993320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Image pref 0:0:0 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:04:55.993812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.virt.hardware [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:04:56.003294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:56.003776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:56.004248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:56.004977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:56.005431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:56.005937 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:56.023397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Getting quotas for project 0f785182c7d64af5ab5d37a4b95275b9. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:04:56.027590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.quota [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Getting quotas for user aef73a49de304706a59335eff37debf0 and project 0f785182c7d64af5ab5d37a4b95275b9. Resources: {'instances', 'ram', 'cores'} {{(pid=120494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:04:56.038477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Going to run 1 instances... {{(pid=120494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:04:56.040820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778b286a-9f4e-4c8e-9460-fe715f0e8fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:04:56.090989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae5f0483-943c-4bfa-8c46-d1b82d281d0f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526448 Sep 07 08:04:56.091643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 525/1026] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 08:04:56.103118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc00dc01-0118-413f-ac78-e06b6c402157 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:56.103899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc00dc01-0118-413f-ac78-e06b6c402157 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:56.161646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc00dc01-0118-413f-ac78-e06b6c402157 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:56.169161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc00dc01-0118-413f-ac78-e06b6c402157 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1219 microversion: 2.1 time: 0.070010 Sep 07 08:04:56.175346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 502/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:56 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:57.194303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:57.195057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:57.205081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:57.205871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:57.206330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:57.207049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:57.207708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:57.208172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:57.277663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:57.286248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a3ad8ad-722a-4a3e-83e9-b9f4907be09f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1279 microversion: 2.1 time: 0.096785 Sep 07 08:04:57.290640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 526/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:57 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:58.314291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:58.314925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:58.317596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:04:58.324694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:58.326530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:58.326982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:58.327684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:58.328180 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:58.328609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:58.550253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:58.558564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0734e46a-68c2-4eed-9669-edd8cd2f0a0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.247926 Sep 07 08:04:58.559444 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 503/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:58 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:04:58.704567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-2dd7e534-4884-4e19-9427-421731b064c5 req-69aaea1a-66ac-43cc-8bad-edc23e5fb7bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe19217f-e207-4d14-ab09-b60b3f86d950", "tag": "26e8b2e2-43fc-4676-bfe2-2cb84a23f272"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:04:58.718236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2dd7e534-4884-4e19-9427-421731b064c5 req-69aaea1a-66ac-43cc-8bad-edc23e5fb7bd service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:58.718709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2dd7e534-4884-4e19-9427-421731b064c5 req-69aaea1a-66ac-43cc-8bad-edc23e5fb7bd service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:58.719326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-2dd7e534-4884-4e19-9427-421731b064c5 req-69aaea1a-66ac-43cc-8bad-edc23e5fb7bd service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:58.730851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-2dd7e534-4884-4e19-9427-421731b064c5 req-69aaea1a-66ac-43cc-8bad-edc23e5fb7bd service nova] Creating event network-changed:26e8b2e2-43fc-4676-bfe2-2cb84a23f272 for instance fe19217f-e207-4d14-ab09-b60b3f86d950 on hv-cinder-83602 Sep 07 08:04:58.735739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-2dd7e534-4884-4e19-9427-421731b064c5 req-69aaea1a-66ac-43cc-8bad-edc23e5fb7bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035639 Sep 07 08:04:58.736376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 527/1030] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:04:59.583684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:04:59.584318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:04:59.590796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:59.591286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:59.591884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:59.592652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:04:59.593123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:04:59.593556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:04:59.729684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:04:59.737168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f9d83fc6-7492-4939-ab3b-0b813540afa5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.157402 Sep 07 08:04:59.737713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 504/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:04:59 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:00.761731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:00.762612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:00.769569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:00.770065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:00.770499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:00.771196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:00.771646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:00.772067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:00.906454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:00.914472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec519274-d290-4ca9-80a5-db78246b9b55 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.157653 Sep 07 08:05:00.915040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 528/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:00 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:01.939151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:01.939710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:01.946243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:01.946726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:01.947163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:01.947856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:01.949092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:01.949588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:02.081276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:02.088831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1233655f-c9d7-40cb-854c-adfbfb9005ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.153846 Sep 07 08:05:02.089425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 505/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:01 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:03.111707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:03.112380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:03.118835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:03.119320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:03.119755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:03.120484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:03.120934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:03.121357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:03.248493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:03.256127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4590998f-9a16-47ac-b2d5-385acecf898b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.149210 Sep 07 08:05:03.256917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 529/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:03 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:04.279417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:04.280030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:04.286365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:04.286843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:04.287275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:04.287957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:04.288433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:04.288855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:04.417738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:04.425507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fe3f386e-ed67-42f2-9be6-cf0af494711f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.150621 Sep 07 08:05:04.426057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 506/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:04 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:04.915200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-ba122384-9e71-447d-8a0b-a54e086dfa05 req-8b07357a-bf59-4936-b486-4b41d3be8e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe19217f-e207-4d14-ab09-b60b3f86d950", "name": "network-vif-plugged", "status": "completed", "tag": "26e8b2e2-43fc-4676-bfe2-2cb84a23f272"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:05:04.924858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba122384-9e71-447d-8a0b-a54e086dfa05 req-8b07357a-bf59-4936-b486-4b41d3be8e43 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:04.925339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba122384-9e71-447d-8a0b-a54e086dfa05 req-8b07357a-bf59-4936-b486-4b41d3be8e43 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:04.925762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-ba122384-9e71-447d-8a0b-a54e086dfa05 req-8b07357a-bf59-4936-b486-4b41d3be8e43 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:04.937717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-ba122384-9e71-447d-8a0b-a54e086dfa05 req-8b07357a-bf59-4936-b486-4b41d3be8e43 service nova] Creating event network-vif-plugged:26e8b2e2-43fc-4676-bfe2-2cb84a23f272 for instance fe19217f-e207-4d14-ab09-b60b3f86d950 on hv-cinder-83602 Sep 07 08:05:04.942523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-ba122384-9e71-447d-8a0b-a54e086dfa05 req-8b07357a-bf59-4936-b486-4b41d3be8e43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031233 Sep 07 08:05:04.943112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 530/1036] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:05:05.449172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:05.449752 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:05.456397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:05.456877 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:05.457334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:05.458172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:05.458730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:05.459208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:05.589684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:05.597344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1c4351ba-bea9-4c18-9db6-ef0c81c22a92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.152920 Sep 07 08:05:05.597887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 507/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:05 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:06.618027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=2 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:06.618793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell0:SELECT=10 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:06.623077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:06.623814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:06.630866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:06.631361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:06.631803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:06.632522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:06.633006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:06.633434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:06.766229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:06.773805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-36a7885c-33d0-4ed6-8150-f10eea81efee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1319 microversion: 2.1 time: 0.157191 Sep 07 08:05:06.774373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 531/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:06 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:07.402230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-400008678", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1041568426", "security_groups": [{"name": "tempest-secgroup-smoke-1037639459"}], "block_device_mapping_v2": [{"uuid": "9cb4e505-9fb4-4b3c-a49d-c422b884e268", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "02722511-a71f-4292-83fc-4f414de3824a"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:05:07.416144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:07.516910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] validate_networks() for [('02722511-a71f-4292-83fc-4f414de3824a', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 08:05:07.797826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:07.798809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:07.805268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:07.805826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:07.806337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:07.807097 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:07.807660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:07.808183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:07.886079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 08:05:07.886513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 08:05:07.886998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 08:05:07.887437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 08:05:07.887881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 08:05:07.897361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:07.897476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:07.897866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:07.898588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:07.899038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:07.899457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:07.916707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Getting quotas for project e2744f91a6284e0688af92a926c199d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 08:05:07.921282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Getting quotas for user 19af2d1084c14c3ea2df8369855aaed0 and project e2744f91a6284e0688af92a926c199d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 08:05:07.950373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:07.958369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e41aa11e-85a9-4621-8155-4b584418120b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1508 microversion: 2.1 time: 0.164425 Sep 07 08:05:07.959132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 532/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:07 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:05:07.982162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 08:05:07.982490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf8261f7-e6e5-4774-bfb0-bc36bc71338c", "device": "/dev/sdb"}} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:05:07.984285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9cb4e505-9fb4-4b3c-a49d-c422b884e268',volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 08:05:07.985189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:07.992129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:07.992619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:07.993078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:07.993842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:07.994371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:07.994799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:08.116973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d5e68a0a-7238-4c67-9ce5-8cc98a782355 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718580 Sep 07 08:05:08.120654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 508/1040] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 7 08:05:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 08:05:08.128907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cf5b1e3e-2670-43b4-abc0-cfe85bbc58c5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:08.129737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cf5b1e3e-2670-43b4-abc0-cfe85bbc58c5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:08.192267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cf5b1e3e-2670-43b4-abc0-cfe85bbc58c5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:08.202760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cf5b1e3e-2670-43b4-abc0-cfe85bbc58c5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1094 microversion: 2.1 time: 0.077499 Sep 07 08:05:08.204110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 509/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:05:08.280178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db2bc8c6-92c6-47b5-8822-cc043fbf90ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "POST /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302368 Sep 07 08:05:08.280851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 533/1042] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 7 08:05:07 2022] POST /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:05:09.226831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:09.227377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:09.234365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:09.234847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:09.235280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:09.235962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:09.236445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:09.236864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:09.301472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:09.309605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-82584adf-aaa1-4cb7-a526-e9a255ac41a5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1192 microversion: 2.1 time: 0.086690 Sep 07 08:05:09.310431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 510/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:10.333859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:10.335424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:10.343371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:10.344234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:10.344767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:10.345518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:10.346170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:10.346779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:10.490976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:10.502375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-82170f47-a065-4e13-baab-d00098002a3a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1278 microversion: 2.1 time: 0.172658 Sep 07 08:05:10.502963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 534/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:10.952511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-e517be41-f615-406e-8eaa-55f702ecbbf3 req-dc8ee26f-1c43-42f6-9657-50c968c612a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac", "tag": "855bfabd-dc8c-4e74-b615-5b7bcd6029cc"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:05:10.962871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-e517be41-f615-406e-8eaa-55f702ecbbf3 req-dc8ee26f-1c43-42f6-9657-50c968c612a9 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:10.963399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-e517be41-f615-406e-8eaa-55f702ecbbf3 req-dc8ee26f-1c43-42f6-9657-50c968c612a9 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:10.964793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-e517be41-f615-406e-8eaa-55f702ecbbf3 req-dc8ee26f-1c43-42f6-9657-50c968c612a9 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:10.975629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-e517be41-f615-406e-8eaa-55f702ecbbf3 req-dc8ee26f-1c43-42f6-9657-50c968c612a9 service nova] Creating event network-changed:855bfabd-dc8c-4e74-b615-5b7bcd6029cc for instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac on hv-cinder-83602 Sep 07 08:05:10.981003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-e517be41-f615-406e-8eaa-55f702ecbbf3 req-dc8ee26f-1c43-42f6-9657-50c968c612a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032535 Sep 07 08:05:10.981586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 511/1045] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 08:05:11.535963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:11.536627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:11.543471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:11.543967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:11.544440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:11.545145 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:11.545605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:11.546035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:11.684683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:11.692791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-18cb9418-1205-40c8-82fc-9ab3f882bd88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1278 microversion: 2.1 time: 0.160872 Sep 07 08:05:11.693362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 535/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:12.716422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:12.717049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:12.718992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:12.724378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:12.724867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:12.725304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:12.725991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:12.726448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:12.726885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:12.858977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:12.866646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b60673bc-8f5d-478f-a487-9f16b3c884e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1278 microversion: 2.1 time: 0.155033 Sep 07 08:05:12.867198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 512/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:13.889637 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:13.890171 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:13.892644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:13.897902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:13.898396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:13.898836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:13.899538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:13.900006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:13.900464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:14.037796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:14.045625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94be6538-b65d-4976-a065-96b7acf772fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1278 microversion: 2.1 time: 0.160655 Sep 07 08:05:14.046628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 536/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:15.069822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:15.070568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:15.077972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:15.078472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:15.079006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:15.079760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:15.080210 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:15.080761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:15.316826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:15.325262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2167cd55-41f5-4858-9b0a-8e8912821b45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1278 microversion: 2.1 time: 0.259748 Sep 07 08:05:15.325815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 513/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:16.348024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:16.348663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:16.355813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:16.356319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:16.356751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:16.357433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:16.357885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:16.358332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:16.493653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:16.501526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3ec2b8dc-ad0a-4723-8e8f-93b3b1059c9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.157362 Sep 07 08:05:16.502091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 537/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:17.526808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:17.527417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:17.533867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:17.534351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:17.534789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:17.535479 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:17.535938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:17.536391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:17.670238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:17.677769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fb1d32f1-e5df-4cf8-92bc-4a5cd307c88d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.155436 Sep 07 08:05:17.678319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 514/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:18.700607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:18.701223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:18.707804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:18.708337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:18.708782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:18.709481 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:18.709942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:18.710370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:18.839212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:18.846946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47afe8ed-3789-4f71-8486-e6f2d2bf086e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.150245 Sep 07 08:05:18.847519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 538/1052] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:19.869811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:19.870947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:19.872982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:19.873666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=8 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:19.880024 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:19.880531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:19.880963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:19.881651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:19.882099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:19.882521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:20.016218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:20.025967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-417651d4-612e-4b7a-9990-7d0f9eef56bb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.160041 Sep 07 08:05:20.026521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 515/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:21.048812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:21.049347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:21.056207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:21.056707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:21.057144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:21.057966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:21.058342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:21.058773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:21.201597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:21.209327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d0be1e12-c0dc-4b88-afa4-a62b29f9afd5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.164580 Sep 07 08:05:21.209891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 539/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:22.232946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:22.233558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:22.239893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:22.240424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:22.240851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:22.241537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:22.241992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:22.242416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:22.374546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:22.382309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-464557c7-b5f0-4cb2-82f6-0cfbe5e79f17 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153857 Sep 07 08:05:22.382873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 516/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:23.405165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:23.405709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:23.412072 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:23.416891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:23.416891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:23.416891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:23.416891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:23.417851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:23.848339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:23.857947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-33fbbb62-d0db-46bc-b2d8-17b655561a67 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.456737 Sep 07 08:05:23.858518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 540/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:24.880072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:24.880700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:24.886845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:24.887320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:24.887749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:24.888461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:24.888912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:24.889334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:25.018142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:25.025741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3ff374ef-11db-4236-b29f-994ea09ab69b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.149659 Sep 07 08:05:25.026282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 517/1057] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:26.048580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:26.049218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:26.055709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:26.056226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:26.056662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:26.057350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:26.058486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:26.058987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:26.063133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:26.190951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:26.198641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3194e7d3-eae9-49b2-8c75-11f9acbc9420 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153819 Sep 07 08:05:26.199196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 541/1058] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:27.220794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:27.221392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:27.227988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:27.228508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:27.228946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:27.229750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:27.230433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:27.230863 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:27.358946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:27.366485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5b0cb513-f676-4c43-a1d9-6f6c6f1ca67c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.149553 Sep 07 08:05:27.367040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 518/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:28.390925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:28.391534 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:28.398287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:28.398769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:28.399198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:28.399880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:28.400375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:28.400799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:28.533254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:28.540852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23f4ccc9-efc4-49eb-9462-87bb62558ec5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153780 Sep 07 08:05:28.541411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 542/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:29.563955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:29.564492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:29.570922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:29.571402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:29.571837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:29.572549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:29.573002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:29.573426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:29.577256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=83 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:29.705224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:29.712818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-edad18d2-d0f7-4c65-8019-64a1552ac459 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153069 Sep 07 08:05:29.713377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 519/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:30.735368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:30.735980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:30.742532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:30.743015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:30.743448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:30.744160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:30.744620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:30.745086 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:30.874781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:30.882357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-212cbc4f-7e69-4604-9c9d-a3ad3dc27671 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.150955 Sep 07 08:05:30.882916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 543/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:31.905595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:31.906205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:31.912789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:31.913274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:31.913714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:31.914399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:31.914856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:31.915280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:32.048662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:32.056279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-785aa0f4-2fc6-4a25-a3b6-9f31b191cd98 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.155003 Sep 07 08:05:32.056834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 520/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:33.078897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:33.079509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:33.085974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:33.086463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:33.086902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:33.087593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:33.088052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:33.088601 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:33.223271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:33.231109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-61706485-db8d-43a6-b933-275e8d003d71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.156161 Sep 07 08:05:33.231669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 544/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:05:34.253907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:34.254509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:34.261583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:34.262057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:34.262485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:34.263163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:34.263615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:34.264039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:34.398430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:34.406178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8c2ffa77-a3da-4fe4-889d-9bf2989d9e37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.156276 Sep 07 08:05:34.406726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 521/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:35.428904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:35.429512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:35.436412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:35.436892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:35.437321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:35.437997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:35.438445 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:35.438865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:35.569894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:35.578405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f98bf55-da6c-4d6a-9f1a-a6fa869504b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153329 Sep 07 08:05:35.578982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 545/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:36.601207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:36.601808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:36.608685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:36.609169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:36.609598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:36.610277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:36.610854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:36.611279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:36.741699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:36.755768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a5c0d1d0-367d-4f9b-9be6-a2b74ae19030 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.158216 Sep 07 08:05:36.756379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 522/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:37.778526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:37.779075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:37.785470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:37.785962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:37.786408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:37.787103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:37.787565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:37.787998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:37.916435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:37.924193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba666f13-4231-403d-a258-b0b7e6063089 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.149637 Sep 07 08:05:37.924767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 546/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:38.946682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:38.947295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:38.954399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:38.954885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:38.955319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:38.956007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:38.956486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:38.956915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:39.027305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:05:39.027571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:05:39.090696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:39.098405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-41efbf94-4ca0-4db3-bfe6-6993de99075e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.155585 Sep 07 08:05:39.098955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 523/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:40.120727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:40.125350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:40.128180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:40.128698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:40.129134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:40.129835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:40.130319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:40.130746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:40.265338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:40.273018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-49379ab3-78ff-411a-b888-37ffaae16c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.156216 Sep 07 08:05:40.273590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 547/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:41.295554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:41.296172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:41.302520 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:41.302998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:41.303427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:41.304127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:41.304582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:41.305003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:41.436334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:41.443927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0cdb33cd-35d3-4627-b4d8-18d71f229ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.152228 Sep 07 08:05:41.444501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 524/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:42.467488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:42.468029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:42.474667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:42.475152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:42.475592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:42.476339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:42.476800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:42.477225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:42.607311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:42.615011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-32e76f30-b400-4629-8624-a314335549f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.152019 Sep 07 08:05:42.615574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 548/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:43.637499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:43.638041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:43.640533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:43.645961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:43.646450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:43.646892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:43.647579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:43.648031 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:43.648477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:43.780519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:43.788186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-45148bc9-5b7c-4c3e-9e50-25b1d0a13ce6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.154702 Sep 07 08:05:43.788765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 525/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:44.812248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:44.812862 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:44.815165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:44.820493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:44.820977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:44.821424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:44.822103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:44.823271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:44.823888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:44.957969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:44.966474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b54cc4f8-f520-4ec1-9402-b2189c999c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.158357 Sep 07 08:05:44.967040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 549/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:45.988650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:45.989258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:45.995668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:45.996178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:45.996615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:45.997302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:45.997760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:45.998178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:46.132686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:46.140673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-78308a12-b478-43ea-ae56-3f208326a35c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.155920 Sep 07 08:05:46.141237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 526/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:47.164180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:47.164795 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:47.172198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:47.172685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:47.173123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:47.173810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:47.174300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:47.174831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:47.305988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:47.314588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf9b325a-6814-4f95-b792-253736c41fe4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.154366 Sep 07 08:05:47.315155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 550/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:48.337785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:48.339051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:48.345521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:48.346006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:48.346443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:48.347133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:48.347590 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:48.348013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:48.480550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:48.488111 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0dcb685f-6d16-45ad-ace2-7a55935e3636 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.154242 Sep 07 08:05:48.488669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 527/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:49.510510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:49.511117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:49.517069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:49.517551 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:49.517985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:49.518675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:49.519132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:49.519557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:49.649925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:49.657804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba9145d3-f21d-415f-87f3-07793dd21f57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.151371 Sep 07 08:05:49.658368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 551/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:50.680877 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:50.681484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:50.689252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:50.689738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:50.694180 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:50.695012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:50.695495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:50.695927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:50.830184 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:50.837786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3aa10e1e-138c-4490-b09a-b1e42c3dbf43 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.160741 Sep 07 08:05:50.838512 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 528/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:51.861296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:51.861849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:51.868323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:51.868807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:51.869238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:51.869924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:51.870468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:51.870895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:52.002421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:52.010032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8c21267d-0790-4c8d-96d9-a78a48846b14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.152658 Sep 07 08:05:52.010584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 552/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:53.033768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:53.034382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:53.040836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:53.041327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:53.041768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:53.043427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:53.043896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:53.044364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:53.177578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:53.185540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dfe4e3fc-14e3-4316-b86f-ba8ed2cdf830 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.155643 Sep 07 08:05:53.186092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 529/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:54.208452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:54.209062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:54.215912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:54.216430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:54.216865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:54.217547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:54.218000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:54.218421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:54.347519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:54.355668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-992204f5-ce52-4d67-9a40-06eeafbf5846 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.151159 Sep 07 08:05:54.356246 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 553/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:05:55.378623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:55.379245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:55.385709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:55.386200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:55.386639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:55.387825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:55.388328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:55.388755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:55.517479 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:55.525293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c42ac92e-bc5d-4023-ada8-e54666b1f0ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.150679 Sep 07 08:05:55.525887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 530/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:56.549084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:56.549697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:56.556146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:56.556634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:56.557072 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:56.557762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:56.558220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:56.558648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:56.562003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=78 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:05:56.691063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:56.698654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d3f56c33-4cf4-4825-b8fb-44077f822fb2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153433 Sep 07 08:05:56.699219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 554/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:57.721295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:57.721851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:57.728319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:57.728799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:57.729229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:57.729909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:57.730365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:57.730792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:57.862505 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:57.869991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-90e97f35-2f57-4da0-b4a1-82664673e893 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.152658 Sep 07 08:05:57.870555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 531/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:05:58.893603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:05:58.894207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:05:58.900652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:58.901568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:58.902010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:58.902699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:05:58.903147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:05:58.903573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:05:59.031897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:05:59.039832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0f2cd2a7-d4d1-42e8-b161-31237b47426d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.150846 Sep 07 08:05:59.040446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 555/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:05:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:00.062830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:00.063433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:00.069933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:00.070426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:00.070935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:00.071780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:00.072302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:00.072781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:00.075290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=78 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:06:00.205521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:00.213621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e1f6ae9b-f902-47ff-8709-b2bf85f85a20 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.154874 Sep 07 08:06:00.214264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 532/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:01.236546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:01.237160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:01.243464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:01.244000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:01.244398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:01.245087 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:01.245540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:01.245963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:01.378317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:01.386105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd7d7a06-6539-4595-ae77-88091ab02ef4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153957 Sep 07 08:06:01.386679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 556/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:02.409761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:02.410366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:02.416796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:02.417277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:02.417707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:02.418394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:02.418846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:02.419264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:02.551663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:02.559219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-70eb65dd-9085-4fbc-ad5c-8a577269a3e0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153393 Sep 07 08:06:02.560041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 533/1089] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:06:03.582553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:03.583098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:03.589539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:03.590035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:03.590475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:03.591177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:03.591637 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:03.592947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:03.723501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:03.731178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0ddf257c-68f4-4c2c-bc2c-932cc97c650c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.152684 Sep 07 08:06:03.731736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 557/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:04.754003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:04.754609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:04.761074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:04.761640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:04.761981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:04.762662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:04.763112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:04.763533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:04.897211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:04.905456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-93f79ade-7b62-47d7-bbf9-fe2c3dba612f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.155277 Sep 07 08:06:04.906004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 534/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:05.928497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:05.929155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:05.936662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:05.937081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:05.937508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:05.938189 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:05.938638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:05.939056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:06.072517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:06.080491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8f6fa33d-1083-452e-b4a6-0608c5c0be78 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.155816 Sep 07 08:06:06.081054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 558/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:07.102896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:07.103507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:07.110893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:07.111376 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:07.111805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:07.112517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:07.112966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:07.113384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:07.244700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:07.252659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2b06eb14-369c-48b8-aff0-2349fada716a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.153587 Sep 07 08:06:07.253223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 535/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:08.276560 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:08.277178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:08.283799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:08.284322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:08.284758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:08.285448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:08.285903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:08.286326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:08.421791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:08.429789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca1253aa-ce26-4c97-b84e-c9318bee8eba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.157068 Sep 07 08:06:08.430363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 559/1094] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:09.453350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:09.453903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:09.460014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:09.460509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:09.460942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:09.461627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:09.462078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:09.462496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:09.592071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:09.599773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5f209ff5-c70c-4c43-9b73-fbd0800f9bc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.150981 Sep 07 08:06:09.600351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 536/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:10.622612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:10.624002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:10.630447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:10.630935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:10.631381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:10.632095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:10.632558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:10.632988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:10.760947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:10.769396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1387aded-aae1-4b4a-8313-d4f055f184ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.150594 Sep 07 08:06:10.769970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 560/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:11.791869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:11.792432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:11.798996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:11.799477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:11.799908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:11.800627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:11.801080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:11.801502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:11.929558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:11.937410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9ea13c12-db22-40d1-b78e-b306f4f5a1cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.149422 Sep 07 08:06:11.937974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 537/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:12.959518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:12.960195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:12.966681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:12.967238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:12.967683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:12.968408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:12.968877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:12.969306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:13.102593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:13.110436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3506ea79-dc84-4e83-88ba-abc9571b117a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.154809 Sep 07 08:06:13.110933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 561/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:14.134654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:14.135374 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:14.137867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:06:14.143685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:14.144209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:14.144654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:14.145358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:14.145820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:14.146250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:14.282459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:14.290106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a5a120f5-4e72-42f4-9ef0-a6057b7ee127 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.159587 Sep 07 08:06:14.290659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 538/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:15.313967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:15.314586 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:15.316940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:06:15.322102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:15.322590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:15.323031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:15.323735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:15.324230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:15.324664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:15.459936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:15.467577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-280a6ce0-0ed8-477f-8f9f-8f876269fc54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.158323 Sep 07 08:06:15.468152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 562/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:16.490558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:16.491124 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:16.497581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:16.498066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:16.498508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:16.499359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:16.499662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:16.500203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:16.629006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:16.636591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-14c58741-ce1a-4054-a740-d076c2b518a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.149982 Sep 07 08:06:16.637142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 539/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:17.431031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-f99c680d-fa23-490f-8d1c-d88e39b945a9 req-7eaa4af8-e190-4ac0-a5a7-a79393e47e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac", "name": "network-vif-plugged", "status": "completed", "tag": "855bfabd-dc8c-4e74-b615-5b7bcd6029cc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:06:17.443006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f99c680d-fa23-490f-8d1c-d88e39b945a9 req-7eaa4af8-e190-4ac0-a5a7-a79393e47e88 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:17.443493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f99c680d-fa23-490f-8d1c-d88e39b945a9 req-7eaa4af8-e190-4ac0-a5a7-a79393e47e88 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:17.443918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-f99c680d-fa23-490f-8d1c-d88e39b945a9 req-7eaa4af8-e190-4ac0-a5a7-a79393e47e88 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:17.455350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-f99c680d-fa23-490f-8d1c-d88e39b945a9 req-7eaa4af8-e190-4ac0-a5a7-a79393e47e88 service nova] Creating event network-vif-plugged:855bfabd-dc8c-4e74-b615-5b7bcd6029cc for instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac on hv-cinder-83602 Sep 07 08:06:17.460797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-f99c680d-fa23-490f-8d1c-d88e39b945a9 req-7eaa4af8-e190-4ac0-a5a7-a79393e47e88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089521 Sep 07 08:06:17.461458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 563/1102] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:06:17.659430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:17.660049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:17.666661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:17.667161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:17.667599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:17.668371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:17.668955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:17.669385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:17.835176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:17.842846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-74e72bfe-7b12-4a22-89fd-6b3281451148 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.187969 Sep 07 08:06:17.844015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 540/1103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:18.867276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:18.868028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:18.874618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:18.875163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:18.875611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:18.876374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:18.876865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:18.877296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:19.014462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:19.022367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a03c5aa-697d-4198-80c0-a42cd41ba08b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1266 microversion: 2.1 time: 0.159745 Sep 07 08:06:19.022919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 564/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:20.045502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:20.046055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:20.053611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:20.054102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:20.054538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:20.055226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:20.055680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:20.056133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:20.188372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:20.195956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ac224eac-99d7-4223-b5ff-350b75e275cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1454 microversion: 2.1 time: 0.154458 Sep 07 08:06:20.196541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 541/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:20.217559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:06:20.218172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:06:20.224653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:20.225135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:20.225581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:20.226267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:20.226724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:20.227152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:20.358049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:06:20.366409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1a812ad3-54fb-42df-bd9c-b434028109a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1454 microversion: 2.1 time: 0.152654 Sep 07 08:06:20.366982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 565/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:06:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:06:22.194534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-88a4d25d-2ee2-403e-9422-7bcc5b6338f6 req-2ca1e8cf-3842-4f15-925a-b7c05cee18e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac", "tag": "855bfabd-dc8c-4e74-b615-5b7bcd6029cc"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:06:22.204529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-88a4d25d-2ee2-403e-9422-7bcc5b6338f6 req-2ca1e8cf-3842-4f15-925a-b7c05cee18e1 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:06:22.205007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-88a4d25d-2ee2-403e-9422-7bcc5b6338f6 req-2ca1e8cf-3842-4f15-925a-b7c05cee18e1 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:06:22.205436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-88a4d25d-2ee2-403e-9422-7bcc5b6338f6 req-2ca1e8cf-3842-4f15-925a-b7c05cee18e1 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:06:22.216866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-88a4d25d-2ee2-403e-9422-7bcc5b6338f6 req-2ca1e8cf-3842-4f15-925a-b7c05cee18e1 service nova] Creating event network-changed:855bfabd-dc8c-4e74-b615-5b7bcd6029cc for instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac on hv-cinder-83602 Sep 07 08:06:22.223286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-88a4d25d-2ee2-403e-9422-7bcc5b6338f6 req-2ca1e8cf-3842-4f15-925a-b7c05cee18e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090863 Sep 07 08:06:22.224204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 542/1107] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:08:19.518660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [14d2c7bd-6627-41c3-8661-8d9eef22655b] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 08:08:19.519510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=7 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:19.520268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=67 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:19.522088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:08:19.522340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:08:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:08:19.523388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:08:19.523552 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:08:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:08:19.528226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:19.528833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:19.538234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:19.538728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:19.539163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:19.539856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:19.540358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:19.540779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:19.566562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Going to try to terminate instance {{(pid=120494) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:08:19.640455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4bcf6bb-e917-4e60-a1ed-d5237cf52410 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 204 len: 0 microversion: 2.1 time: 0.123588 Sep 07 08:08:19.643979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 566/1108] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:08:19 2022] DELETE /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:08:19.648296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=9 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:19.649078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=61 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:19.650009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:08:19.650155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:08:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:08:19.655104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:19.655796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:19.665605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:19.666087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:19.666519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:19.667204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:19.667657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:19.668100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:19.801166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:19.809525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85f12729-245a-47fc-967a-13bcee69f0a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1578 microversion: 2.1 time: 0.164086 Sep 07 08:08:19.810082 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 543/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:20.834681 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:20.835384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:20.845990 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] [14d2c7bd-6627-41c3-8661-8d9eef22655b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50426. Sep 07 08:08:20.850125 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:20.850605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:20.851039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:20.851726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:20.852209 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:20.852631 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:20.982930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:20.991315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-359743ed-75f7-4886-87f0-1b2311049edb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1578 microversion: 2.1 time: 0.161397 Sep 07 08:08:20.991897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 567/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:22.015231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:22.016066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:22.022878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:22.023366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:22.023819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:22.024538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:22.024995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:22.025421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:22.265746 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:22.274976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-af7521ef-69db-4cff-8e53-4cefa9fe474a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1578 microversion: 2.1 time: 0.264244 Sep 07 08:08:22.275547 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 544/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1578 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:23.023060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [req-a8a8be1b-cd5c-45ee-9089-f18e9a542ecc req-5ac4320d-9f8b-41f0-8577-b06c479294bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac", "name": "network-vif-deleted", "tag": "855bfabd-dc8c-4e74-b615-5b7bcd6029cc"}]} {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:08:23.035397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a8a8be1b-cd5c-45ee-9089-f18e9a542ecc req-5ac4320d-9f8b-41f0-8577-b06c479294bb service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:23.036018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a8a8be1b-cd5c-45ee-9089-f18e9a542ecc req-5ac4320d-9f8b-41f0-8577-b06c479294bb service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:23.037083 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [req-a8a8be1b-cd5c-45ee-9089-f18e9a542ecc req-5ac4320d-9f8b-41f0-8577-b06c479294bb service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:23.050055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.compute.server_external_events [req-a8a8be1b-cd5c-45ee-9089-f18e9a542ecc req-5ac4320d-9f8b-41f0-8577-b06c479294bb service nova] Creating event network-vif-deleted:855bfabd-dc8c-4e74-b615-5b7bcd6029cc for instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac on hv-cinder-83602 Sep 07 08:08:23.054908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [req-a8a8be1b-cd5c-45ee-9089-f18e9a542ecc req-5ac4320d-9f8b-41f0-8577-b06c479294bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109413 Sep 07 08:08:23.055886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 568/1112] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:08:23.298903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:23.299520 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:23.306630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:23.307120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:23.307564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:23.308365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:23.308824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:23.309253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:23.373570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:23.382641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-daf9649c-c477-4701-b4bb-0bf739da4c35 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087515 Sep 07 08:08:23.383143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 545/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:24.407289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:24.407992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:24.414214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:24.414701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:24.415142 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:24.415839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:24.416324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:24.416754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:24.481666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:24.489350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-107a018b-4995-46b5-b1b2-c471081a83a2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086822 Sep 07 08:08:24.490423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 569/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:25.512708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:25.513322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:25.519232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:25.519719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:25.520189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:25.521609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:25.522084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:25.522519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:25.582472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:25.590850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-48823be2-b142-4cfb-beca-f4696bca8de5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082162 Sep 07 08:08:25.591403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 546/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:08:26.613788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:26.614339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:26.621215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:26.621707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:26.622149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:26.622842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:26.623303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:26.623727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:26.687718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:26.695399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-971cec98-2362-4cc9-9bc5-c9d7a7d9b797 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085580 Sep 07 08:08:26.695956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 570/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:27.718456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:27.719102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:27.726201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:27.726687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:27.727127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:27.727820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:27.728315 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:27.728743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:27.791583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:27.799307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bae1f154-5215-477b-94bd-9a7182922ccc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084680 Sep 07 08:08:27.799854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 547/1117] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:28.823550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:28.824157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:28.830474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:28.830953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:28.831396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:28.832062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:28.832529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:28.832945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:28.893762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:28.901542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-226e61db-1e41-44ad-a77d-fe287e57049a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081857 Sep 07 08:08:28.902098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 571/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:29.924413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:29.925016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:29.932311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:29.932785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:29.933215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:29.933902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:29.934356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:29.934776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:30.000486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:30.008724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-38139b3d-aadf-45cb-b728-ff726ac44b09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088237 Sep 07 08:08:30.009286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 548/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:31.031588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:31.032250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:31.039338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:31.039830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:31.040324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:31.041020 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:31.041482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:31.041914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:31.105021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:31.112958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db1b62d2-e430-4f74-a24d-8e74d83d51cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085284 Sep 07 08:08:31.113563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 572/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:32.137744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:32.138341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:32.145005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:32.145519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:32.146179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:32.147023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:32.147481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:32.147909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:32.209707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:32.217463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-03f9e163-3d28-4d9c-9953-da30043a3b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083932 Sep 07 08:08:32.218020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 549/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:32 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:33.241628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:33.242267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:33.248672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:33.249165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:33.249603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:33.250293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:33.250752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:33.251176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:33.314967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:33.323331 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b48e6258-176c-4bf9-b859-68641ecafa80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086155 Sep 07 08:08:33.323901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 573/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:34.346171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:34.346784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:34.354113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:34.354445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:34.354891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:34.355587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:34.356042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:34.356499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:34.418014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:34.425611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-27da71f6-f45a-4c06-8446-d04215134552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083402 Sep 07 08:08:34.426163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 550/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:35.448403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:35.449010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:35.455343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:35.455819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:35.456291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:35.456972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:35.457424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:35.457845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:35.519242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:35.527589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-48fb8a47-d95f-4fca-8cc6-e22c7184b465 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083066 Sep 07 08:08:35.528166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 574/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:36.550168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:36.550783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:36.557534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:36.557958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:36.558395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:36.559083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:36.559541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:36.559965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:36.621051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:36.628646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8b4924ea-6a83-4781-92b3-2421c3692c75 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082372 Sep 07 08:08:36.629217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 551/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:37.651537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:37.652103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:37.658616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:37.659100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:37.659536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:37.660263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:37.660725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:37.661666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:37.725694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:37.733219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-01dfd838-e5fa-43ac-920d-f18f6a7f04e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085624 Sep 07 08:08:37.733776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 575/1126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:38.757427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:38.757983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:38.764401 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:38.764881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:38.765313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:38.766004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:38.766455 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:38.766876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:38.831961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:38.839821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-32ad9472-91e9-4498-b199-6f9391c2f51c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086993 Sep 07 08:08:38.840596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 552/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:39.863139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:39.863740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:39.870347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:39.870759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:39.871191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:39.871882 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:39.872358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:39.872780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:39.934624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:39.943764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3ead9a5-c99f-4ccf-8d9d-c0534a957c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084316 Sep 07 08:08:39.944541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 576/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:40.966848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:40.967449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:40.974774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:40.975256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:40.975696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:40.976433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:40.976891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:40.977317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:41.038433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:41.046191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8f231f6-100c-46a6-976b-dafba36b9b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083316 Sep 07 08:08:41.046762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 553/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:42.068788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:42.069351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:42.075819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:42.076337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:42.076768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:42.077452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:42.077904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:42.078325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:42.144485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:42.152576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08cfc5ea-e941-4551-af26-f93d0005a938 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087795 Sep 07 08:08:42.153152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 577/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:43.176027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:43.176704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:43.183513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:43.184005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:43.184480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:43.185188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:43.185650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:43.186338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:43.248657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:43.256968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9b5c0bd5-2dbb-4ae6-a886-a83b5e894c88 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084978 Sep 07 08:08:43.257525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 554/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:44.279223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:44.279832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:44.286179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:44.286661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:44.287091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:44.287775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:44.288262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:44.288685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:44.350979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:44.358803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afc9fffc-c7b5-432a-8ffb-ef700b7e56d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083536 Sep 07 08:08:44.359389 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 578/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:45.382559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:45.383177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:45.389626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:45.390108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:45.390557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:45.391231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:45.391686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:45.392135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:45.454554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:45.462405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fc44a385-46d0-479d-9a0e-d84923dc5dab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084479 Sep 07 08:08:45.462980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 555/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:46.485416 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:46.486021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:46.492717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:46.493227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:46.493691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:46.494386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:46.494851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:46.495348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:46.556241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:46.564130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94ca95ab-b63e-44df-9ba6-22eece499f45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082492 Sep 07 08:08:46.564647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 579/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:47.587749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:47.588387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:47.594798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:47.595285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:47.595723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:47.596447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:47.596906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:47.597334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:47.661091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:47.669485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2d510e62-8c63-4cc1-8cb9-d19d6a18b6aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086362 Sep 07 08:08:47.670049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 556/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:48.692412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:48.693026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:48.699459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:48.699940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:48.700407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:48.701099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:48.701552 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:48.701977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:48.763202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:48.770940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d284db6-8879-4541-b0d5-ad4c5e5957d4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082466 Sep 07 08:08:48.771597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 580/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:49.793551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:49.794103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:49.796383 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=29 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:49.801755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:49.802241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:49.803235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:49.803956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:49.804443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:49.804866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:49.807706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=85 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:49.872626 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:49.880186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-21a4e527-e381-460e-af01-19be6ea33053 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.090554 Sep 07 08:08:49.881370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 557/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:50.903362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:50.904026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:50.906280 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:50.911462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:50.911997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:50.912494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:50.913197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:50.913649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:50.914095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:50.918878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:08:50.981797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:50.989868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9df9c9b9-36c3-416e-aabb-51e3f2760832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.090703 Sep 07 08:08:50.990567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 581/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:52.013173 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:52.013776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:52.020565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:52.021055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:52.021493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:52.022220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:52.022691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:52.023120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:52.085041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:52.093203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-230ce64b-0a69-4a04-9450-0905eb014c14 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083844 Sep 07 08:08:52.093773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 558/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:53.115622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:53.116972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:53.123453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:53.123930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:53.124390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:53.125071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:53.125526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:53.125935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:53.187762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:53.195442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f6f47c37-779f-448b-a0cd-a80d3c9f0b83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083660 Sep 07 08:08:53.196001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 582/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:54.217907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:54.218511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:54.224592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:54.225101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:54.225636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:54.226396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:54.226855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:54.227277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:54.288675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:54.296284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-01592f78-f1b1-457c-8067-9939656c480f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082183 Sep 07 08:08:54.296844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 559/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:55.320143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:55.320763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:55.327141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:55.327635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:55.328065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:55.328779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:55.329234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:55.329660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:55.390934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:55.399202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ecb37d9a-fc0c-4608-abec-39a08633c06e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083483 Sep 07 08:08:55.399698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 583/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:56.422110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:56.422666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:56.429972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:56.430462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:56.430903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:56.431595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:56.432062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:56.432516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:56.496668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:56.504328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-23016f9b-0554-464b-915b-5f6935f15585 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086190 Sep 07 08:08:56.504896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 560/1143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:57.526771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:57.527312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:57.533786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:57.534267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:57.534703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:57.535391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:57.535848 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:57.536309 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:57.599045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:57.607309 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e40d156-5f74-46f3-aa8d-4ffee295e6c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084569 Sep 07 08:08:57.607872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 584/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:58.630300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:58.630907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:58.638682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:58.639159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:58.639590 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:58.640314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:58.640767 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:58.641187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:58.705013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:58.712752 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5995c880-9607-4ad5-8228-1001480fbd0d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086388 Sep 07 08:08:58.713335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 561/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:08:59.734770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:08:59.735371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:08:59.741802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:59.742284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:59.742721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:59.743395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:08:59.743839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:08:59.744288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:08:59.806763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:08:59.814666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-70099558-f7a7-4b4b-813e-75deb957fbac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083781 Sep 07 08:08:59.815227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 585/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:08:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:00.837839 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:00.838448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:00.844962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:00.845441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:00.845873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:00.846554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:00.847006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:00.847427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:00.910927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:00.919262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-01090848-9ee0-4478-94c7-422687855dc0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085585 Sep 07 08:09:00.919814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 562/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:01.941872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:01.942485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:01.949511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:01.949998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:01.950443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:01.951133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:01.951590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:01.952016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:02.013307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:02.021525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b552d750-a590-44fb-960d-bf44111b2828 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083542 Sep 07 08:09:02.022089 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 586/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:03.044198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:03.044860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:03.051275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:03.051753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:03.052215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:03.052896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:03.053348 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:03.053775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:03.114875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:03.122739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6d71082d-0a64-40f8-a219-c85947dd9555 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082495 Sep 07 08:09:03.123296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 563/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:04.145597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:04.146232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:04.153336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:04.153819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:04.154255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:04.154975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:04.155431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:04.155857 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:04.216825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:04.224588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bc75adf0-b198-4fa1-bd0f-eed04d693e42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082966 Sep 07 08:09:04.225162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 587/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:05.248424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:05.249011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:05.255441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:05.255930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:05.256407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:05.257101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:05.257559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:05.257990 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:05.321558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:05.329462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ef202c86-3cfa-41a9-872b-17a059568139 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085837 Sep 07 08:09:05.330030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 564/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:06.351686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:06.352377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:06.359690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:06.360205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:06.360643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:06.361336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:06.361792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:06.362218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:06.423851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:06.432239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a17db6f-2acb-4e31-9ebd-50c26a2f415c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083941 Sep 07 08:09:06.432804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 588/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:07.455908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:07.456529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:07.463463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:07.463944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:07.464393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:07.465074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:07.465526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:07.465948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:07.526483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:07.534305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fbd59b01-1ed5-4639-921d-c9bee9b1cc76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082277 Sep 07 08:09:07.534867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 565/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:08.556314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:08.557043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:08.563797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:08.564328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:08.564756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:08.565491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:08.565922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:08.566347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:08.629922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:08.637804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b36a55db-9aa0-4411-bdbb-2ae6b352f40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085398 Sep 07 08:09:08.638400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 589/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:09.660612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:09.661148 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:09.668161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:09.668643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:09.669075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:09.669761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:09.670211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:09.670634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:09.732227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:09.739822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-97c755e2-7dac-4668-a9b4-8563ddbeac37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083143 Sep 07 08:09:09.740431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 566/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:10.763253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:10.763863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:10.770361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:10.770850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:10.771292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:10.771989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:10.772473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:10.772900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:10.835250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:10.843222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5819ffa9-a365-4b5c-95d5-97c4ec77718f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084438 Sep 07 08:09:10.843791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 590/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:11.865152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:11.865718 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:11.872643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:11.873132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:11.873569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:11.874271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:11.874730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:11.875165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:11.939743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:11.947545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e3b5cd49-378f-4469-bc5e-319a7ce2c121 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086525 Sep 07 08:09:11.948124 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 567/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:12.971430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:12.972005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:12.978463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:12.978952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:12.979393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:12.980771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:12.981231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:12.981659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:13.044505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:13.052239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b3e632a7-a08b-46a9-85d4-21db52d1a7fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085057 Sep 07 08:09:13.052806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 591/1158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:14.075991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:14.076636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:14.083144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:14.083679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:14.084576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:14.085460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:14.086256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:14.086687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:14.150329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:14.158084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4172b737-bb75-4def-8504-9d5ea7d5085e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086370 Sep 07 08:09:14.158641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 568/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:09:15.181018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:15.181626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:15.188879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:15.189357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:15.189787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:15.190471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:15.190922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:15.191341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:15.253949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:15.262303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7de3ed77-fd17-4d62-b7bc-9053746bf5f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085175 Sep 07 08:09:15.262856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 592/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:16.284918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:16.285565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:16.292532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:16.292949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:16.293383 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:16.294072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:16.294530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:16.294955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:16.356045 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:16.363772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-55d7c798-aa44-46c3-b95a-2ffd31888512 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082784 Sep 07 08:09:16.364366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 569/1161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:17.387418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:17.388031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:17.394493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:17.394972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:17.395403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:17.396102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:17.396557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:17.397008 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:17.459965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:17.467679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7dc1d96-1c66-4b8a-9c73-a9b92f832ebd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084869 Sep 07 08:09:17.468258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 593/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:18.491792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:18.492434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:18.498928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:18.499416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:18.499858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:18.500582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:18.501045 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:18.501472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:18.562065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:18.569828 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7389f9fc-c875-4140-a35a-267db253ea8e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081902 Sep 07 08:09:18.570398 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 570/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:19.597678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:19.598215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:19.605651 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:19.606135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:19.606573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:19.607264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:19.607713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:19.608157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:19.669454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:19.677074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-801508ae-e6b9-4f25-abc0-d5887e1f69e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088649 Sep 07 08:09:19.677632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 594/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:20.700346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:20.700956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:20.703242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:20.708548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:20.709027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:20.709462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:20.710144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:20.710595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:20.711020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:20.715084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:20.773948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:20.781864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-047b6994-4cb8-4023-b6a4-9328ea23084c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086181 Sep 07 08:09:20.782459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 571/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:21.805292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:21.805832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:21.807707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:21.813079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:21.813561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:21.813991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:21.814670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:21.815119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:21.815537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:21.818216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:21.877701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:21.885397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76971d53-35d0-4c99-9f70-e6268124108a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084217 Sep 07 08:09:21.886568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 595/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:22.908408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:22.909015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:22.915349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:22.915830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:22.916292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:22.917834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:22.918330 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:22.919258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:22.991113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:22.999285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ae2da92a-f4dc-43b6-830b-6df515e85f28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.094831 Sep 07 08:09:22.999879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 572/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:24.041987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:24.042748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:24.049331 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:24.049822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:24.050261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:24.050956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:24.051414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:24.051840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:24.113689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:24.122047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d96e643c-2971-45cc-bd07-c5a91ba14153 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083988 Sep 07 08:09:24.122614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 596/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:25.145146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:25.145808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:25.152425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:25.152905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:25.153336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:25.154017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:25.154463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:25.154883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:25.220158 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:25.227735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-af8feb30-53eb-4d27-9ed9-a08e8aa44312 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086668 Sep 07 08:09:25.228324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 573/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:26.250884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:26.251849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:26.258744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:26.259239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:26.259678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:26.260442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:26.260907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:26.261333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:26.327262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:26.335039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e2f6c0e8-5a30-462f-bcd3-34a54064babc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088084 Sep 07 08:09:26.335602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 597/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:27.357659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:27.358213 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:27.364686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:27.365169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:27.365601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:27.366289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:27.366743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:27.367165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:27.429637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:27.438394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4294bc86-1708-497c-b126-1e4292543aa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084837 Sep 07 08:09:27.438974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 574/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:28.461602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:28.462236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:28.469266 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:28.469748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:28.470186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:28.470863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:28.471314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:28.471735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:28.766568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:28.774264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-91c345cd-78f1-4152-a8ad-f0d58c540237 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.316552 Sep 07 08:09:28.774827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 598/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:29.798341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:29.798865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:29.806970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:29.808102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:29.808717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:29.809415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:29.809873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:29.810300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:29.871647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:29.879403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9ed2aa02-2f5b-4693-b1ca-42fc7773114a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085083 Sep 07 08:09:29.879963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 575/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:30.902360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:30.902976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:30.909431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:30.909915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:30.910354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:30.911051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:30.911503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:30.911925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:30.973468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:30.981384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cd1cbe9f-4467-48bd-85c6-c83622d48f5c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082908 Sep 07 08:09:30.981952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 599/1174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:32.004232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:32.004838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:32.011233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:32.012292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:32.012761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:32.013449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:32.013904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:32.014331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:32.080105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:32.088140 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2b3ed846-22c4-4a15-b626-dae051072bd2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087754 Sep 07 08:09:32.088712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 576/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:33.110804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:33.111409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:33.117738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:33.118218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:33.118650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:33.119332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:33.119783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:33.120239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:33.180153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:33.189654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c55ddc5f-8805-45b7-ba4c-d8057892115f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082819 Sep 07 08:09:33.190251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 600/1176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:34.212806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:34.213414 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:34.220499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:34.220982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:34.221415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:34.222101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:34.222561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:34.222987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:34.286082 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:34.293882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-163d7986-7aef-4c5f-a936-54b691f18f36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084948 Sep 07 08:09:34.294450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 577/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:35.316210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:35.316824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:35.323178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:35.323664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:35.324757 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:35.325451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:35.325909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:35.326336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:35.389963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:35.397732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1efc8f33-abb9-4e59-adfb-8cc99e88b59c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085350 Sep 07 08:09:35.398295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 601/1178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:36.420968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:36.421606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:36.428129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:36.428609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:36.429051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:36.429723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:36.430179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:36.430600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:36.490776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:36.498419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bf68b5bd-72c8-4707-bba4-8f111d7d1f06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082162 Sep 07 08:09:36.499000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 578/1179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:37.521487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:37.522128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:37.528898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:37.529385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:37.529823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:37.530512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:37.530967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:37.531394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:37.594781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:37.602451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e8a5d568-ea1b-479a-a273-0f997f88fbb8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084930 Sep 07 08:09:37.603009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 602/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:38.625656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:38.626172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:38.632663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:38.633189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:38.633629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:38.634331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:38.634789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:38.635218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:38.697360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:38.705221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e4b4d728-5b80-4d70-9bd7-cf094d4c459b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084446 Sep 07 08:09:38.705775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 579/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:39.727809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:39.728363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:39.735168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:39.735655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:39.736108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:39.736804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:39.737261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:39.737685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:39.798514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:39.806184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35e9c869-b25b-4a15-b0ad-87bfc32afcd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082386 Sep 07 08:09:39.806751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 603/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:40.829786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:40.830393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:40.836818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:40.837297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:40.837728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:40.838414 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:40.838865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:40.839310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:40.905109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:40.912750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ad4401df-06f7-4741-974e-16f96bc64e3f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086838 Sep 07 08:09:40.913306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 580/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:41.934813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:41.935421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:41.942758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:41.943244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:41.943684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:41.944403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:41.944863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:41.945289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:42.009612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:42.017876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7e038e98-6791-4043-87a8-2ffdb14b19f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087010 Sep 07 08:09:42.018442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 604/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:43.040885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:43.041525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:43.049046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:43.049524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:43.049955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:43.050642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:43.051091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:43.051510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:43.112784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:43.120362 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-467c9859-a360-4802-86fb-0f2d141d3f6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083334 Sep 07 08:09:43.120986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 581/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:44.142770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:44.143375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:44.149903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:44.150454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:44.150884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:44.151573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:44.152172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:44.152750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:44.213238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:44.220870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffc45c39-9e3a-4f38-ad4d-6a37090cc4d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081995 Sep 07 08:09:44.221430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 605/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:45.243958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:45.244622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:45.251580 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:45.252070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:45.252538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:45.253228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:45.253685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:45.254115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:45.315899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:45.323572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-25243c01-7b85-48f9-ad8f-dea7e5e9cce4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083535 Sep 07 08:09:45.324152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 582/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:46.392120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:46.392739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:46.398605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:46.399092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:46.399527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:46.400247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:46.400991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:46.401424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:46.467872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:46.475537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88b4198c-0603-4ddd-8a16-b2aa1e3386de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.132763 Sep 07 08:09:46.476114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 606/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:47.498368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:47.498983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:47.505607 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:47.506088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:47.506525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:47.507211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:47.507666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:47.508107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:47.568839 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:47.576457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7c87248e-53a5-41d8-b4cc-035c2a3b2531 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082426 Sep 07 08:09:47.577016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 583/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:48.598971 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:48.599493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:48.606680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:48.607163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:48.607605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:48.608323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:48.608783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:48.609214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:48.670359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:48.678085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a79b7f99-3286-4383-bfc5-107ba845d0c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083088 Sep 07 08:09:48.678647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 607/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:49.702064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:49.702678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:49.709036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:49.709548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:49.709982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:49.710770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:49.711227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:49.711655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:49.776523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:49.784662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ca83a6fb-258a-4a10-87cb-9ae0ebaf07af tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087327 Sep 07 08:09:49.785229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 584/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:50.807004 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:50.807617 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:50.814521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:50.815003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:50.815466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:50.816177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:50.816639 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:50.817060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:50.877963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:50.885543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3f5f84a5-f49c-492d-9a7f-45cb9fe71064 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082405 Sep 07 08:09:50.886112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 608/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:51.909456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:51.910073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:51.912421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:51.919104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:51.919712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:51.920182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:51.920886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:51.921346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:51.921786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:51.924538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:51.985828 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:51.993702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2810d592-2a7e-464a-b29a-a8f87d02df9e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088118 Sep 07 08:09:51.994273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 585/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:53.016252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:53.016799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:53.019081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:53.024354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:53.024832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:53.025263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:53.025948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:53.026399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:53.026818 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:53.029555 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:09:53.089232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:53.097055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c459ec0c-cc40-4d39-ae07-4ec9be2118ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084818 Sep 07 08:09:53.097620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 609/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:54.120003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:54.120567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:54.127470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:54.127986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:54.128458 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:54.129148 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:54.129613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:54.130041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:54.191310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:54.199070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4dcac399-368a-436e-8856-fc38cfc748cc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083087 Sep 07 08:09:54.200678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 586/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:55.222516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:55.223128 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:55.229466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:55.229943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:55.230402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:55.231175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:55.231643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:55.232055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:55.295692 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:55.303317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e4ba25cd-48ce-4c50-abf6-84a9c53f89f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084726 Sep 07 08:09:55.303873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 610/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:56.326003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:56.326616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:56.333009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:56.333498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:56.333936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:56.334625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:56.335081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:56.335504 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:56.401646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:56.409794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d706783d-a2d8-4602-813f-691d6f87cb1e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087891 Sep 07 08:09:56.410346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 587/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:57.432306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:57.432984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:57.440732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:57.441219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:57.441661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:57.442359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:57.442815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:57.443241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:57.508344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:57.516363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2768cfd4-c3c8-4393-83da-1b2650a1a9d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087965 Sep 07 08:09:57.516929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 611/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:58.539011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:58.539616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:58.546412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:58.546893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:58.547328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:58.548008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:58.548485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:58.548906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:58.611696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:58.619280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b11f7e43-9ce7-4100-92de-7d3a5b2a9ca9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084095 Sep 07 08:09:58.619834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 588/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:09:59.642946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:09:59.643562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:09:59.650926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:59.651408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:59.651847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:59.652566 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:09:59.653027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:09:59.653451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:09:59.715048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:09:59.723511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-155a292b-f91a-43e7-aa30-ae74b0e2a207 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084433 Sep 07 08:09:59.724092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 612/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:09:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:00.746095 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:00.746710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:00.749946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:10:00.750098 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:10:00.751103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:10:00.751219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:10:00.761232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:00.761750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:00.762289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:00.763857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:00.764613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:00.765087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:00.829371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:00.837070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6f8e37c9-9373-4610-add5-313e963345c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.094938 Sep 07 08:10:00.837651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 589/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:01.860489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:01.861042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:01.867384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:01.867867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:01.868339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:01.869034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:01.869491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:01.869922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:01.930238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:01.938772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75f87faa-5143-4218-b18d-44761a98c3ea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082964 Sep 07 08:10:01.939341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 613/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:02.961875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:02.962484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:02.969589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:02.970070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:02.970507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:02.971194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:02.971679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:02.972131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:03.034078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:03.042050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-012115c3-7080-499f-8f85-b4c25d9ba2f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083779 Sep 07 08:10:03.042805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 590/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:10:04.065711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:04.066332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:04.072850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:04.073374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:04.073815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:04.074518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:04.074980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:04.075870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:04.142385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:04.150176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4e354e33-e1ca-4352-a37e-9ab930780c5a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088805 Sep 07 08:10:04.150748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 614/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:10:05.173386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:05.173997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:05.180885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:05.181370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:05.181810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:05.182506 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:05.182960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:05.183388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:05.244223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:05.252445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0683a27b-1913-4434-aa20-3463076435f9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083606 Sep 07 08:10:05.253006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 591/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:06.275049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:06.275662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:06.282371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:06.282857 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:06.283296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:06.283984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:06.284476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:06.284901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:06.346272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:06.353949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0a02fa8a-e215-402c-82ce-809e5a6ffcaa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082789 Sep 07 08:10:06.354517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 615/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:07.377341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:07.377963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:07.384507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:07.384996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:07.385436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:07.386127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:07.386581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:07.387038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:07.450346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:07.457995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-29f25eb5-10f7-4455-935e-8d63b5be5028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085147 Sep 07 08:10:07.458555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 592/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:08.480957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:08.481491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:08.487991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:08.488500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:08.488932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:08.489611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:08.490062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:08.490484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:08.550644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:08.558181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2d689e52-057e-40bd-8fb6-a26237c0d361 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081263 Sep 07 08:10:08.558740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 616/1208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:09.581879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:09.582412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:09.588968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:09.589451 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:09.589888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:09.590600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:09.591055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:09.592163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:09.652449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:09.660908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-67fbdd04-f687-4e1c-89cf-6caac4df68bc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082934 Sep 07 08:10:09.661519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 593/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:10:10.683167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:10.683811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:10.691135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:10.691656 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:10.692140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:10.692840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:10.693296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:10.693752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:10.756395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:10.764814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb4979e1-cbee-4aab-a8c5-c3f3b35afefa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085488 Sep 07 08:10:10.765380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 617/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:11.788208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:11.788921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:11.795928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:11.796543 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:11.797039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:11.797750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:11.799260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:11.799705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:11.863661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:11.871453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fbd914fd-fed6-43ed-9e2d-f3732bb98565 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087167 Sep 07 08:10:11.872015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 594/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:12.894923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:12.895531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:12.901960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:12.902441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:12.902875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:12.903559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:12.904048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:12.904581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:12.967832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:12.975548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a40bdaca-38f1-429b-a963-31cae00aebb5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084477 Sep 07 08:10:12.976135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 618/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:13.998474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:13.999194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:14.005637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:14.006113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:14.006540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:14.007215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:14.007667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:14.008107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:14.070053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:14.079109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2b32e93b-3da8-490f-8b2d-c0331d427556 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084520 Sep 07 08:10:14.079689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 595/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:15.104629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:15.105337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:15.112827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:15.113308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:15.113737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:15.114428 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:15.114880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:15.115303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:15.183982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:15.192432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a8c52e05-8f96-4ab9-93c3-57385533224d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.093235 Sep 07 08:10:15.193010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 619/1214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:16.215326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:16.215919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:16.222426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:16.222908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:16.223336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:16.224017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:16.224495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:16.224916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:16.332822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:16.340477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9e1f5acb-bee0-48f0-97f5-86f7dcd77552 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.128946 Sep 07 08:10:16.341031 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 596/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:17.362825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:17.363417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:17.369843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:17.370323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:17.370759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:17.371442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:17.371893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:17.372346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:17.434919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:17.443840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c3dead53-e626-4c12-b5d1-81b01641e1c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084850 Sep 07 08:10:17.444451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 620/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:18.466612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:18.467325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:18.474256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:18.474741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:18.475201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:18.475898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:18.476385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:18.476812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:18.537708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:18.545422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e82b46ac-0573-4836-8a89-af4e215880b6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082687 Sep 07 08:10:18.546490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 597/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:19.568298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:19.568912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:19.575274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:19.575757 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:19.576215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:19.576901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:19.578003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:19.578430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:19.639058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:19.647386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-272180ef-af53-4248-ad25-4596636b88dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082934 Sep 07 08:10:19.647947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 621/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:20.669584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:20.670199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:20.676737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:20.677221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:20.677659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:20.678349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:20.678804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:20.679231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:20.740318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:20.747815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-60bf7662-1417-4ecd-b6c3-2015e55e034a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082124 Sep 07 08:10:20.748428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 598/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:21.770674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:21.771237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:21.777668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:21.778159 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:21.778598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:21.779320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:21.779784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:21.780749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:21.844221 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:21.851863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-63ba12b2-606b-4fc0-8de7-bc1700e24f10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085201 Sep 07 08:10:21.852468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 622/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:22.874703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:22.875933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:22.878359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:22.883454 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:22.883934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:22.884387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:22.885074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:22.885524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:22.885946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:22.888767 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:22.947646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:22.955367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-28ee890d-929d-4687-8966-4a100e66acae tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084609 Sep 07 08:10:22.955927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 599/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:23.977687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:23.978313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:23.980653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:23.985948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:23.986433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:23.986869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:23.987557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:23.988017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:23.988470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:23.991154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:24.095267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:24.102947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-06eac751-6bf0-4a7c-9bc9-2f7db1645383 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.129168 Sep 07 08:10:24.103511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 623/1222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:10:25.126494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:25.127066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:25.133356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:25.133842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:25.134277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:25.134974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:25.135430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:25.135854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:25.207256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:25.215098 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2900c8a2-10f7-424e-affc-499771f34d9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.092850 Sep 07 08:10:25.215672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 600/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:26.239127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:26.239743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:26.246158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:26.246638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:26.247071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:26.247758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:26.248247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:26.248672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:26.312311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:26.320432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-855454ea-f4e0-4cd5-aeca-36173527afbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085763 Sep 07 08:10:26.321002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 624/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:27.343067 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:27.343666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:27.350163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:27.350648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:27.351082 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:27.351770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:27.352262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:27.352693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:27.414663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:27.423090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-18515784-78fa-41cc-b4a4-251cdd09b5be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083884 Sep 07 08:10:27.423652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 601/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:28.446751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:28.447363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:28.454504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:28.454982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:28.455417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:28.456132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:28.456590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:28.457014 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:28.520355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:28.528139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-111acee2-ab8a-4fa9-8fd2-c2ff699c9b05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085203 Sep 07 08:10:28.528701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 625/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:29.550799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:29.551485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:29.557895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:29.558380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:29.558814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:29.559511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:29.559969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:29.560421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:29.620950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:29.628591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4a9450c9-768e-4ef4-8376-9b4199e18ced tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081722 Sep 07 08:10:29.629152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 602/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:10:30.650658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:30.651272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:30.658360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:30.658841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:30.659274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:30.659958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:30.660441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:30.660864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:30.724220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:30.731821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fd4d79e0-7e11-416b-8d95-dae384a44a8a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085041 Sep 07 08:10:30.732411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 626/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:31.755087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:31.755640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:31.762307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:31.762786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:31.763218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:31.763910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:31.764389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:31.764813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:31.833270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:31.840936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8f067639-f33d-42bf-8032-f8b1dbc48877 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.090401 Sep 07 08:10:31.841569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 603/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:32.863337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:32.863955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:32.870479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:32.870960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:32.871388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:32.872096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:32.872550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:32.872971 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:32.934058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:32.943211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a68240f-1ae6-47dc-b722-02028f3bdd16 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084360 Sep 07 08:10:32.943783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 627/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:32 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:33.966563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:33.967176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:33.974134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:33.974613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:33.975049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:33.975738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:33.976223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:33.976650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:34.037582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:34.045252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-be059cfc-e8f4-4911-8f23-f822b9cec40f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082567 Sep 07 08:10:34.045812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 604/1231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:35.068537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:35.069152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:35.075697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:35.076266 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:35.076737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:35.077426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:35.077878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:35.078300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:35.147346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:35.155077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbc0d7c8-178b-4f6e-ba97-54b91429ec4c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.090395 Sep 07 08:10:35.155641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 628/1232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:36.178263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:36.178873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:36.185248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:36.185760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:36.186467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:36.187155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:36.187612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:36.188040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:36.248932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:36.257472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2de8e4f5-2b61-4e5c-82f2-d73ee0297393 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083016 Sep 07 08:10:36.258025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 605/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:37.280746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:37.281346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:37.288541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:37.289022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:37.289464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:37.290153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:37.290612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:37.291036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:37.352417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:37.360107 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9b67227-1f4b-4988-89c2-35b96fb5bf0a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083148 Sep 07 08:10:37.360676 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 629/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:38.382640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:38.383250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:38.389741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:38.390219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:38.390653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:38.391382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:38.392228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:38.392657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:38.453178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:38.460842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e21aad0a-237b-4608-bda0-21c802e68aa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082084 Sep 07 08:10:38.461398 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 606/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:10:39.483721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:39.484277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:39.491642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:39.492168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:39.492610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:39.493303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:39.493763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:39.494187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:39.557900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:39.566626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66a1f41d-6119-4112-87ad-7c2ab91cdaa8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086857 Sep 07 08:10:39.567190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 630/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:40.588385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:40.588923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:40.595601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:40.596109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:40.596548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:40.597239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:40.597694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:40.598120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:40.661725 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:40.669464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5ea236d3-a34d-48f8-a8b6-0f7a40233f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085080 Sep 07 08:10:40.670028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 607/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:41.692879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:41.693514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:41.700062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:41.700577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:41.701011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:41.701716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:41.702172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:41.702597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:41.765142 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:41.772840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1cafad53-f9e8-47e2-b387-99db9d2e3ade tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084394 Sep 07 08:10:41.773403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 631/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:42.795334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:42.795975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:42.802734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:42.803224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:42.803658 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:42.804805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:42.804902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:42.805263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:42.870323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:42.878677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-be98b66e-17a4-489b-a1be-cbc637ed35f4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087173 Sep 07 08:10:42.879239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 608/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:43.902860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:43.903489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:43.910306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:43.910782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:43.911218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:43.911899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:43.912390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:43.912813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:43.973726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:43.981341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9b7b9fc-2627-43dd-8895-32e95a817909 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082405 Sep 07 08:10:43.981899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 632/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:45.005909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:45.006472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:45.012780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:45.013267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:45.013703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:45.014395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:45.014850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:45.015275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:45.078212 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:45.086478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7cbb2356-ab12-421b-86c6-46af340d4094 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085601 Sep 07 08:10:45.087034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 609/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:46.109287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:46.109856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:46.116522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:46.116999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:46.117429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:46.118108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:46.118558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:46.119006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:46.178985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:46.187161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b1f54f3e-2715-4142-be70-6d208ed8d2a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081868 Sep 07 08:10:46.187724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 633/1242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:47.217040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:47.217682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:47.224844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:47.225323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:47.225811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:47.226494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:47.226943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:47.227365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:47.288574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:47.296115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-33cb7303-2964-4a33-9301-83ea619961ef tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082856 Sep 07 08:10:47.296672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 610/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:48.319410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:48.320009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:48.326381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:48.326858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:48.327291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:48.327978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:48.328469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:48.328912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:48.393437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:48.401165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f58f8e17-bc6a-4b04-af56-3d0c40aeef48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085708 Sep 07 08:10:48.401726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 634/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:49.423843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:49.424478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:49.430845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:49.431321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:49.431750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:49.432452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:49.432899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:49.433319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:49.496226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:49.504677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8accfe47-cf41-4df3-9317-51bf4218661a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084724 Sep 07 08:10:49.505255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 611/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:50.528010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:50.528641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:50.535541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:50.536007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:50.536463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:50.537153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:50.537670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:50.538023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:50.600715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:50.608415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-483737fb-a3b7-4c27-ba88-d5eea761f708 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084176 Sep 07 08:10:50.608984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 635/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:51.632473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:51.633138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:51.639459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:51.639939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:51.640416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:51.641107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:51.642281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:51.642686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:51.703185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:51.711000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-be6469e7-7c30-4bac-b044-a0a301a90c05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082492 Sep 07 08:10:51.711565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 612/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:52.733086 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:52.733723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:52.739893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:52.740406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:52.740839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:52.741521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:52.741970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:52.742393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:52.803209 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:52.813141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9084c1d6-6816-4c5f-8fad-3f9080f59055 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083793 Sep 07 08:10:52.815290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 636/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:53.838009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:53.838549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:53.840565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:53.846325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:53.846812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:53.847250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:53.847945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:53.848430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:53.848858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:53.851579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:53.910068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:53.917701 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8563d7c-3f31-4143-b398-ade9e8c3556a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083781 Sep 07 08:10:53.918257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 613/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:54.941412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:54.941948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:54.944398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:54.950133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:54.950624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:54.951061 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:54.951751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:54.952232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:54.952656 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:54.956216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:10:55.015595 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:55.024034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ec6eac9b-c2bc-41f3-9a1a-c08fb411fb46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086972 Sep 07 08:10:55.024612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 637/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:56.046893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:56.047436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:56.054515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:56.055004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:56.055439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:56.056308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:56.056779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:56.057252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:56.118167 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:56.125899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-568cd7eb-5f1a-469c-9900-9791c76909cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082931 Sep 07 08:10:56.126450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 614/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:57.148424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:57.149040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:57.155377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:57.155856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:57.156329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:57.157032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:57.157496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:57.158029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:57.223515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:57.231583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-168fcda7-81f8-4576-b4c9-3e32a1fe03ad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087030 Sep 07 08:10:57.232169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 638/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:58.255827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:58.256456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:58.262830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:58.263307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:58.263738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:58.264454 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:58.264906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:58.265333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:58.331313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:58.338920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-70bfefa1-102a-408c-b18c-dca87406d866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087217 Sep 07 08:10:58.339478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 615/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:10:59.361377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:10:59.362018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:10:59.368379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:59.368858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:59.369290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:59.369969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:10:59.370423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:10:59.370842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:10:59.432925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:10:59.441041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eca2ef92-1876-4b0d-99d1-e838ecb79206 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083633 Sep 07 08:10:59.441544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 639/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:10:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:00.463923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:00.464557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:00.471843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:00.472352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:00.472792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:00.473480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:00.473936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:00.474363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:00.537185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:00.544831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4da71e42-aff9-477b-a45e-db2e4352a69d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084889 Sep 07 08:11:00.545400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 616/1255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:01.568923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:01.569537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:01.575956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:01.576476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:01.576913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:01.577604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:01.578068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:01.578494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:01.640258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:01.648377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-23cbb5ef-9a7a-45f1-a341-3fe724e24e80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083311 Sep 07 08:11:01.648950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 640/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:02.671447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:02.672015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:02.678586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:02.679062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:02.679493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:02.680200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:02.680650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:02.681070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:02.741110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:02.748670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-311b4cbb-721c-441a-936f-1ef72481e40e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081175 Sep 07 08:11:02.749222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 617/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:03.771446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:03.772056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:03.778513 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:03.779007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:03.779444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:03.780168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:03.780632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:03.781064 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:03.842809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:03.851948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9ad6627f-b7fb-4441-a1f5-2bb3fe0745a6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084076 Sep 07 08:11:03.852553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 641/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:04.875015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:04.876100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:04.882738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:04.883224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:04.883665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:04.884392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:04.884852 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:04.885285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:04.947719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:04.956638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-756cc361-1492-4ffc-9a7c-2f7a496f50ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085491 Sep 07 08:11:04.957238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 618/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:05.978561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:05.979165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:05.986291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:05.986768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:05.987199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:05.987879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:05.988352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:05.988775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:06.051768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:06.059366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e7df98f-5801-4f32-a344-6f0f29e47165 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084603 Sep 07 08:11:06.059922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 642/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:07.082944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:07.083548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:07.090119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:07.090596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:07.091027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:07.091712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:07.092189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:07.092612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:07.155959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:07.163746 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-858bfb44-f577-4791-9eb5-1b97999b8c7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085254 Sep 07 08:11:07.164331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 619/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:08.186386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:08.186997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:08.193407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:08.193880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:08.194310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:08.194996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:08.195448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:08.195866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:08.256410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:08.263957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6c929f02-15a6-460a-a4fe-f1fff2cf61a0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081788 Sep 07 08:11:08.264553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 643/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:09.288203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:09.288816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:09.295229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:09.295707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:09.296170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:09.296857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:09.297985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:09.298425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:09.358467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:09.366779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-496b4eb4-0ec1-44da-b9d4-99b2445dd379 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082567 Sep 07 08:11:09.367337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 620/1263] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:10.389091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:10.389721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:10.396747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:10.397227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:10.397658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:10.398342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:10.398795 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:10.399216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:10.462168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:10.469896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b200f839-a4e5-4aa3-8d79-d73a21166db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084617 Sep 07 08:11:10.470451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 644/1264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:11.491966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:11.492602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:11.498955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:11.499435 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:11.499865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:11.501201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:11.501677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:11.502100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:11.562840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:11.571052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-916b9635-98c2-4f0f-840c-de9d6b277996 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082956 Sep 07 08:11:11.571612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 621/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:12.593394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:12.594105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:12.600477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:12.600952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:12.601380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:12.602060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:12.602509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:12.602930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:12.663782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:12.671664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-777ffb2e-f8c9-4ed5-a0bd-38b316f6cb36 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082097 Sep 07 08:11:12.672786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 645/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:13.694753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:13.695362 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:13.701774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:13.702259 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:13.702692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:13.704000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:13.704995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:13.705379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:13.765080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:13.773206 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d159a57a-1c7b-4c9f-8a7c-bf567f92a591 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082313 Sep 07 08:11:13.773763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 622/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:14.796575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:14.797939 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:14.806077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:14.806562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:14.806998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:14.807722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:14.808214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:14.808643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:14.873202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:14.880922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0efc46f4-3f8f-4c77-8147-db52c55b3137 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088476 Sep 07 08:11:14.881492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 646/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:15.235227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:15.235710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:15.242231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:15.242710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:15.243144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:15.243827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:15.244310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:15.244734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:15.326939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lazy-loading 'services' on Instance uuid fe19217f-e207-4d14-ab09-b60b3f86d950 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:11:15.398880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-87d6d044-716f-42e0-b85e-3164c4ce2ed4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950/os-volume_attachments/cf8261f7-e6e5-4774-bfb0-bc36bc71338c" status: 202 len: 0 microversion: 2.1 time: 0.167428 Sep 07 08:11:15.399462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 623/1269] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 7 08:11:15 2022] DELETE /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950/os-volume_attachments/cf8261f7-e6e5-4774-bfb0-bc36bc71338c => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 08:11:15.903521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:15.904167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:15.910601 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:15.911085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:15.911524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:15.912257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:15.912713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:15.913140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:15.976765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:15.984505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a237e341-fbae-4266-a458-25140eb1e50d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084970 Sep 07 08:11:15.985599 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 647/1270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:17.007875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:17.008821 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:17.015394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:17.016529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:17.017156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:17.017849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:17.018303 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:17.018805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:17.082902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:17.090517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a4e1d4bf-223b-4f1c-9490-53dab2d29382 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086879 Sep 07 08:11:17.091070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 624/1271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:18.113737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:18.114329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:18.120779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:18.121265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:18.121699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:18.122390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:18.122846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:18.123308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:18.183676 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:18.191968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ca8f4588-f2d0-475d-9b6c-72caddec2b1c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082210 Sep 07 08:11:18.192568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 648/1272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:19.214684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:19.215289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:19.222221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:19.222702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:19.223133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:19.223813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:19.224291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:19.224714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:19.285288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:19.292889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ba532f42-d32a-4062-bab3-3f69a09f9a3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082076 Sep 07 08:11:19.293447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 625/1273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:20.317677 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:20.318319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:20.324777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:20.325270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:20.325709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:20.326401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:20.326859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:20.327288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:20.390423 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:20.398414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b97beefc-f7bd-45d2-b813-c784ccbfc968 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085471 Sep 07 08:11:20.399001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 649/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:21.420392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:21.421033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:21.428373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:21.428858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:21.429295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:21.429985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:21.430438 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:21.430861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:21.494387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:21.501963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8eb75f57-c52b-4d71-9dbb-8937f71fdb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085418 Sep 07 08:11:21.502518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 626/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:22.524550 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:22.525154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:22.531046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:22.531521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:22.531952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:22.532664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:22.533112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:22.533532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:22.596650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:22.604288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5bfc6fb2-19cc-4a76-a08c-d466f28f5490 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083777 Sep 07 08:11:22.604853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 650/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:23.627635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:23.628276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:23.634740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:23.635165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:23.635599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:23.636309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:23.636766 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:23.637189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:23.697529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:23.705380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-973fc4f9-e7a4-4d42-8050-4511d84ea53c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081767 Sep 07 08:11:23.705937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 627/1277] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:24.728464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:24.729010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:24.735978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:24.736472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:24.736910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:24.737608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:24.738069 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:24.738497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:24.801855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:24.809632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8e20e49-6007-416b-9a5a-33658169d070 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085220 Sep 07 08:11:24.810195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 651/1278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:25.833449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:25.834003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:25.836666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=30 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:25.841975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:25.842461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:25.842897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:25.843586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:25.844039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:25.844498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:25.847049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:25.908062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:25.915716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a33ed4d8-a7db-4039-b313-0a8e5d280a9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086819 Sep 07 08:11:25.916292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 628/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:11:26.938542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:26.939178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:26.941872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=30 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:26.947952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:26.948575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:26.949165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:26.950388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:26.950846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:26.951525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:26.954699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=90 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:27.018079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:27.026083 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a424597e-847f-43e5-b9df-eaa3afe863bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.091793 Sep 07 08:11:27.026653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 652/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:28.050132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:28.050793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:28.057924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:28.058404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:28.058835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:28.059528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:28.059979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:28.060423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:28.122080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:28.130650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6c151db1-fefb-4277-9b8d-ce775dfa8a92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085144 Sep 07 08:11:28.131223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 629/1281] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:29.153347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:29.153938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:29.160412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:29.160893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:29.161327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:29.162011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:29.162460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:29.162878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:29.225249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:29.233052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6773c8c6-a97c-4486-add6-adcec24a7b57 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083611 Sep 07 08:11:29.233619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 653/1282] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:30.256368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:30.256982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:30.263447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:30.263931 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:30.264398 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:30.265091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:30.265553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:30.265980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:30.330456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:30.338281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-647312e9-033f-4edd-8434-bfb9554b17bd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086361 Sep 07 08:11:30.338860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 630/1283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:31.363406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:31.364147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:31.370790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:31.371351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:31.371874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:31.372710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:31.373254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:31.373686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:31.441905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:31.450358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b030aba8-cb2e-4756-8161-9a0c15d692e7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.091636 Sep 07 08:11:31.451085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 654/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:32.473694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:32.474297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:32.480915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:32.481389 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:32.481817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:32.482494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:32.482945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:32.483365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:32.545113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:32.553465 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-642695ad-a77c-4ea8-bccc-227915dda7c4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083736 Sep 07 08:11:32.554023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 631/1285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:32 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:33.575133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:33.575744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:33.582733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:33.583217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:33.583655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:33.584485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:33.584947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:33.585379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:33.646320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:33.653989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f39447ed-3acf-4506-af18-ab55303ea922 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082823 Sep 07 08:11:33.654547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 655/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:34.676831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:34.677355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:34.684110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:34.684604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:34.685035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:34.685717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:34.686417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:34.686838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:34.750490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:34.758798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-041d4030-1d6d-4aaa-89b9-2892071850cd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086601 Sep 07 08:11:34.759349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 632/1287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:35.781006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:35.781612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:35.788057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:35.788648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:35.789079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:35.789765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:35.790213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:35.790632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:35.851514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:35.859325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5dd88872-0493-40e1-852e-4a1e27e39332 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082059 Sep 07 08:11:35.859891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 656/1288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:36.883009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:36.883617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:36.890568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:36.891041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:36.891469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:36.892217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:36.892851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:36.893272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:36.954181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:36.962172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-79c4c195-b384-4ccc-9ff9-8e698fe2e85b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083031 Sep 07 08:11:36.962740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 633/1289] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:37.983702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:37.984343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:37.991106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:37.991589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:37.992026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:37.992747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:37.993206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:37.993637 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:38.054778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:38.062791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b6fd25c-302b-4126-8e46-26baae07c425 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082864 Sep 07 08:11:38.063351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 657/1290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:39.086784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:39.087381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:39.093871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:39.094356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:39.094796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:39.096195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:39.096655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:39.097115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:39.156939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:39.165189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b134066e-0063-48c5-a872-7505ac2ee081 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082309 Sep 07 08:11:39.165742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 634/1291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:40.187861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:40.188635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:40.190947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:11:40.191091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:11:40.192102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:11:40.192256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:11:40.193103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:11:40.193228 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:11:40.205109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:40.205609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:40.206033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:40.206727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:40.207185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:40.207606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:40.272049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:40.279887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-76b25ff7-a461-4e86-9e73-e802bfd10279 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.096187 Sep 07 08:11:40.280494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 658/1292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:41.302991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:41.303645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:41.306087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:11:41.306221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:11:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:11:41.313089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:41.313573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:41.314667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:41.315363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:41.315822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:41.316277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:41.378222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:41.386049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0c9c1d6d-c0c1-4fb5-ab17-1f515d18a4fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087553 Sep 07 08:11:41.386613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 635/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:42.410283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:42.410929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:42.417482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:42.417960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:42.418395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:42.419088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:42.419543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:42.419967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:42.481335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:42.489675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-596f54d2-e1e0-4ef7-a5f9-26bc6c678cc1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084080 Sep 07 08:11:42.490240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 659/1294] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:43.512896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:43.513448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:43.520201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:43.520688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:43.521122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:43.521816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:43.522272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:43.522698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:43.586441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:43.594089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e004da68-16b9-44d9-8c18-5e4d6cc2805b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085416 Sep 07 08:11:43.594645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 636/1295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:11:44.616824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:44.617430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:44.623892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:44.624409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:44.624846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:44.625542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:44.625995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:44.627022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:44.687869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:44.696334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17fbff3d-4cff-41b0-bec1-f8f9e5eb65fc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083248 Sep 07 08:11:44.697183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 660/1296] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:45.718819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:45.719433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:45.726637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:45.727122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:45.727559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:45.728278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:45.728740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:45.729170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:45.791947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:45.799890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3786363c-f9d9-4d3c-90e0-eff9029cfc08 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084965 Sep 07 08:11:45.800484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 637/1297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:46.822729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:46.823276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:46.829823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:46.830299 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:46.830729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:46.831411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:46.831866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:46.832319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:46.894914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:46.902636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-33b8555e-28e8-4384-80ea-c0d0c48cb200 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083816 Sep 07 08:11:46.903222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 661/1298] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:47.925873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:47.926518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:47.932995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:47.933472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:47.933905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:47.934592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:47.935047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:47.935750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:47.996744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:48.004391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3ff5a816-3cb2-4004-8824-81f91e06d376 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082683 Sep 07 08:11:48.004948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 638/1299] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:49.027263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:49.027875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:49.035044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:49.035526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:49.035964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:49.036683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:49.037139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:49.037570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:49.102399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:49.110210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3cc971ed-944c-49fa-8ee0-4cb3893ae27d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086856 Sep 07 08:11:49.110786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 662/1300] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:50.134113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:50.134726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:50.141170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:50.141661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:50.142103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:50.142796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:50.143362 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:50.143833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:50.204059 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:50.211978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a118d847-2a80-45f1-9171-72d1110af290 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081770 Sep 07 08:11:50.212575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 639/1301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:51.234898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:51.235501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:51.241779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:51.242254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:51.242685 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:51.243361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:51.243807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:51.244253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:51.306197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:51.314059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c329dca2-7f9d-414e-b565-874294c114a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083060 Sep 07 08:11:51.314621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 663/1302] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:52.337705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:52.338317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:52.344769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:52.345253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:52.345689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:52.347003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:52.347457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:52.347886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:52.412710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:52.420837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bf391118-f642-445b-aebd-2e24a07eebd8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086977 Sep 07 08:11:52.421405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 640/1303] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:53.444102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:53.444722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:53.451397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:53.451880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:53.452357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:53.453063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:53.453520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:53.453945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:53.517931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:53.525839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-75f2c483-6a60-499b-b5d4-821437da6739 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086250 Sep 07 08:11:53.526415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 664/1304] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:54.548591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:54.549202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:54.555702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:54.556213 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:54.556651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:54.557336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:54.557789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:54.558211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:54.619325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:54.626952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-11687491-21d3-4989-ac5a-e7a166472c85 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082290 Sep 07 08:11:54.628154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 641/1305] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:55.650268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:55.650811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:55.657244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:55.657729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:55.658162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:55.659462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:55.659917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:55.660375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:55.721149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:55.728748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f80de03b-b7b8-4671-bfdf-fa4f0922fb7b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082438 Sep 07 08:11:55.729315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 665/1306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:56.750816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:56.751335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:56.754370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:56.759533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:56.760016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:56.760478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:56.761168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:56.761623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:56.762049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:56.764791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:56.823620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:56.831905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9bb0cc58-8de5-479e-b8aa-0418c5d4b768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085021 Sep 07 08:11:56.832491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 642/1307] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:57.854271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:57.854805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:57.857154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:57.862324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:57.862810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:57.863240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:57.863924 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:57.864404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:57.864852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:57.867485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:11:57.929762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:57.937758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-55c46d93-5f36-42fa-b84e-83f8b4099f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087420 Sep 07 08:11:57.938315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 666/1308] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:11:58.960876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:11:58.961489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:11:58.968038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:58.968549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:58.968986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:58.969670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:11:58.970128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:11:58.970553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:11:59.036564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:11:59.044262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0c0d9579-e937-4448-adaf-3e787d15b3c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087262 Sep 07 08:11:59.044820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 643/1309] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:11:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:00.067418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:00.068010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:00.074494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:00.074974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:00.075406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:00.076101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:00.076563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:00.076984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:00.137428 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:00.145053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3fe6cbeb-3f0a-44af-bc07-e5912dd23a6b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082375 Sep 07 08:12:00.145618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 667/1310] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:01.167358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:01.167970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:01.174387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:01.174871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:01.175346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:01.176014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:01.176496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:01.176930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:01.242129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:01.249882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-27283346-62fe-4a23-bc40-3d69b0435e52 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086411 Sep 07 08:12:01.250450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 644/1311] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:02.273766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:02.274370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:02.280848 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:02.281330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:02.281760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:02.282441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:02.282891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:02.283311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:02.343953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:02.352250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1f795b74-c007-4fe9-82f9-236a4c34edfb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082419 Sep 07 08:12:02.352808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 668/1312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:03.374572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:03.375203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:03.382190 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:03.382686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:03.383129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:03.384565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:03.384676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:03.385062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:03.450381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:03.458162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-929316aa-bf00-4724-9fa4-921d038135a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087577 Sep 07 08:12:03.458724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 645/1313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:04.482017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:04.482649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:04.489573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:04.490051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:04.490483 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:04.491163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:04.491614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:04.492031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:04.552047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:04.560411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5cfa31b1-4c01-40bd-a343-dcc82c0b70c0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082280 Sep 07 08:12:04.560979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 669/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:12:05.584736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:05.585352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:05.591712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:05.592229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:05.592669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:05.593355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:05.593814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:05.594239 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:05.654783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:05.662974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8cd4e5b6-d944-4a61-9409-062a7225fec2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082315 Sep 07 08:12:05.663531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 646/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:06.685708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:06.686511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:06.693526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:06.694001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:06.694429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:06.695108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:06.695558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:06.695976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:06.761562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:06.769394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d4f02769-9b53-4ecb-bc06-44911e64c734 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087566 Sep 07 08:12:06.769996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 670/1316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:07.792164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:07.792744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:07.799154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:07.799642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:07.800675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:07.801382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:07.801847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:07.802279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:07.865472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:07.873156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f64e56a5-5e4f-496c-9a30-15888918d6d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085058 Sep 07 08:12:07.873716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 647/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:08.897020 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:08.897635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:08.904033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:08.904544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:08.904980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:08.905665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:08.906118 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:08.906541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:08.968070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:08.976397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b32a3b52-56f4-4b93-b419-b9d82432e3aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083953 Sep 07 08:12:08.976963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 671/1318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:09.998793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:09.999382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:10.006030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:10.006507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:10.006942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:10.007622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:10.008093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:10.008515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:10.073776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:10.081984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c7191e26-9880-4b6b-85f7-0d96a96208f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086893 Sep 07 08:12:10.082554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 648/1319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:11.105903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:11.106447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:11.113007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:11.114080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:11.114518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:11.115210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:11.115662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:11.116102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:11.177368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:11.185025 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ee871ca4-c6a4-43c0-9e96-47a798d6113a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083158 Sep 07 08:12:11.185588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 672/1320] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:12.208481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:12.209120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:12.215419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:12.215902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:12.216358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:12.217039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:12.217488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:12.217911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:12.277635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:12.286123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22fcc5bc-774d-4f94-b3d9-217fdb4e69b7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081552 Sep 07 08:12:12.286672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 649/1321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:13.308300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:13.308913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:13.315581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:13.316065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:13.317300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:13.317991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:13.318446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:13.318872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:13.378431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:13.386998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3469f75d-95c6-4b6c-9d56-1d1d9cb4a308 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082601 Sep 07 08:12:13.387567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 673/1322] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:14.409396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:14.410094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:14.417237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:14.417717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:14.418320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:14.419015 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:14.419468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:14.419890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:14.480895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:14.488522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f6bc75da-0034-42b6-993d-64addb90ebdd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082985 Sep 07 08:12:14.489075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 650/1323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:15.514671 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:15.515274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:15.522310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:15.522785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:15.523214 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:15.523901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:15.524378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:15.524801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:15.590047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:15.598278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c16c6147-dc49-4edd-9122-dc96a1908f59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086961 Sep 07 08:12:15.598835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 674/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:16.620112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:16.620735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:16.627150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:16.627639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:16.628091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:16.628793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:16.629240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:16.629665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:16.689841 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:16.698117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6c699173-9309-4caf-b40c-b915eaaea4d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081892 Sep 07 08:12:16.698682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 651/1325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:17.721380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:17.721954 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:17.728853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:17.729332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:17.729766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:17.730447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:17.730899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:17.731349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:17.793327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:17.801366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-94a08983-c70a-4579-8c54-e547e49fa12f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083711 Sep 07 08:12:17.801939 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 675/1326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:18.824256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:18.824843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:18.831105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:18.831581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:18.832195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:18.832897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:18.833355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:18.833778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:18.897454 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:18.905114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8d5a0131-5338-4533-ad6e-0adeb9c5815e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084847 Sep 07 08:12:18.905675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 652/1327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:19.927906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:19.928570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:19.934957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:19.935436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:19.935873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:19.936837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:19.937289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:19.937710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:19.997785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:20.006096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9054f45f-86ac-44a0-8c78-4d0013610f01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082108 Sep 07 08:12:20.006656 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 676/1328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:21.032613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:21.033558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:21.043759 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:21.044524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:21.045190 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:21.046267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:21.046969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:21.047657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:21.111108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:21.118873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fde252ea-04d3-439b-bc62-c34e951f296b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.092490 Sep 07 08:12:21.119423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 653/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:22.141204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:22.141801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:22.148036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:22.148541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:22.148973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:22.149654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:22.150102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:22.150522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:22.215012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:22.223136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-37482052-4fa8-453f-bfb5-55d1a22157f0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085276 Sep 07 08:12:22.223702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 677/1330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:23.245212 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:23.245824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:23.252306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:23.252792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:23.253222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:23.254837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:23.255294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:23.255717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:23.329628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:23.337289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-024285b7-9276-480c-bcff-3695474c0b97 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.095919 Sep 07 08:12:23.337851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 654/1331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:24.359891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:24.360647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:24.367019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:24.367522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:24.367951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:24.368657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:24.369108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:24.369525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:24.435346 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:24.444821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6f0ac933-51a8-470f-8ffc-cbb8085ff768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088798 Sep 07 08:12:24.445412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 678/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:25.467893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:25.468528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:25.475087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:25.475562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:25.475994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:25.476703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:25.477155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:25.477576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:25.537975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:25.545542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ba65465e-eaec-48cc-b694-af47d904a7ce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081634 Sep 07 08:12:25.546091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 655/1333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:26.568928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:26.569547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:26.576541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:26.577281 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:26.578031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:26.578875 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:26.579344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:26.579777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:26.646840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:26.654646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f14bbfee-a11d-4947-bee8-17b9ae3e99d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089930 Sep 07 08:12:26.655210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 679/1334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:27.678733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:27.679294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:27.681554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:27.687018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:27.687496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:27.687929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:27.688649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:27.689096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:27.689515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:27.692845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:27.756522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:27.764134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8e6ceb6a-1097-4dd6-aa46-6307763680d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089899 Sep 07 08:12:27.764689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 656/1335] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:28.786904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:28.787504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:28.789922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:28.795179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:28.795666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:28.796127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:28.796822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:28.797278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:28.797704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:28.801873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:28.859809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:28.867698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f79cc489-d0a3-49dc-8c12-69d062fc7fdb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084893 Sep 07 08:12:28.868291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 680/1336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:29.890686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:29.891292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:29.897832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:29.898307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:29.898737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:29.899415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:29.899864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:29.900483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:29.961547 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:29.969434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a41fc172-9661-470b-8090-5d7ddcc21e09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082655 Sep 07 08:12:29.969984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 657/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:30.991690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:30.992323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:30.998736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:30.999218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:30.999647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:31.000360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:31.000812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:31.001230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:31.062304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:31.071466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26c489f6-2094-4fdc-8fc1-bddc4b01a4d8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083552 Sep 07 08:12:31.072057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 681/1338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:32.094322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:32.094868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:32.102702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:32.103187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:32.103620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:32.104342 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:32.104805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:32.105232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:32.166005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:32.173749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4624b251-cbed-4885-bfcb-9d82965a8d6d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083370 Sep 07 08:12:32.174311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 658/1339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:32 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:33.196657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:33.197264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:33.203739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:33.204241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:33.204676 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:33.205354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:33.205801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:33.206221 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:33.270315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:33.277961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e66ea52d-7a19-4485-9bc0-e8b2261d51d0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085524 Sep 07 08:12:33.278520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 682/1340] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:34.301260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:34.301839 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:34.308192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:34.308667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:34.309094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:34.309775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:34.310224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:34.310644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:34.376432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:34.384919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-709103bd-eff2-4ff3-a558-8b76af698110 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087980 Sep 07 08:12:34.385496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 659/1341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:35.408642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:35.409273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:35.417281 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:35.417768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:35.418207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:35.418916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:35.419362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:35.419787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:35.482890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:35.490880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4a125a62-f6c6-44ae-9634-4f180db78b48 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086102 Sep 07 08:12:35.491448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 683/1342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:36.513762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:36.514367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:36.521489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:36.522016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:36.522463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:36.523195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:36.523655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:36.524103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:36.585360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:36.593044 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-92cbb7b3-4bb2-4f4f-94c2-70a05a179e4e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083147 Sep 07 08:12:36.593599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 660/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:37.617232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:37.617908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:37.625476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:37.625958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:37.626386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:37.627075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:37.627520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:37.627940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:37.690011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:37.697872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9249f68f-f2c2-4d27-b319-c8b2e6f314a7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085825 Sep 07 08:12:37.698428 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 684/1344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:38.721016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:38.721600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:38.728533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:38.729010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:38.729450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:38.730142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:38.730599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:38.731030 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:38.792789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:38.800879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-88ba792e-7294-4f1d-b462-5e16270ee2e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083988 Sep 07 08:12:38.801431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 661/1345] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:39.824099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:39.824713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:39.831689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:39.832289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:39.832728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:39.833418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:39.833874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:39.834298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:39.894917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:39.902586 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ae27c80-dd13-452a-95f2-ae9b11eef3f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082482 Sep 07 08:12:39.903148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 685/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:40.926351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:40.926972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:40.933564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:40.934045 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:40.934480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:40.935231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:40.935687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:40.936381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:40.998221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:41.005869 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f4be4486-64e0-4fde-8c7f-b614925db159 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084290 Sep 07 08:12:41.006421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 662/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:42.028491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:42.029103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:42.035683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:42.036192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:42.036627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:42.037305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:42.037755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:42.038177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:42.101638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:42.109295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb654c4d-1efe-4b6c-a57f-6b24f734bb92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084721 Sep 07 08:12:42.109854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 686/1348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:43.132984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:43.133645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:43.140110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:43.140595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:43.141025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:43.141705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:43.142151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:43.142570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:43.207098 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:43.214717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22e9455f-61e5-4239-8cf1-947c08c240e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085747 Sep 07 08:12:43.215273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 663/1349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:44.237218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:44.237873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:44.244451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:44.244963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:44.245399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:44.246088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:44.246543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:44.246967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:44.308056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:44.316002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8ed2fbc8-8edc-4ab1-a02d-ce64592d9e03 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082611 Sep 07 08:12:44.316597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 687/1350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:45.338644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:45.339232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:45.345560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:45.346042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:45.346473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:45.347768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:45.348247 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:45.348674 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:45.411259 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:45.419492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c03d19f5-e373-4315-ae71-00381234e607 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084708 Sep 07 08:12:45.420048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 664/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:46.443373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:46.443979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:46.450377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:46.450852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:46.451290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:46.451973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:46.452448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:46.452869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:46.514129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:46.521754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1fb337f1-42ea-47d6-8e9d-c27c7b2f320b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082894 Sep 07 08:12:46.522317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 688/1352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:47.542948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:47.543548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:47.550027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:47.550505 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:47.550932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:47.551617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:47.552089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:47.552514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:47.612672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:47.620191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ececac54-b53c-4bf9-ac3f-bcc7d30bbba3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081097 Sep 07 08:12:47.620774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 665/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:48.643930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:48.644535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:48.650982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:48.651466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:48.651903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:48.652665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:48.652665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:48.653523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:48.717678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:48.725958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b006ce74-36bf-4419-9856-ae6bc777cb05 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086502 Sep 07 08:12:48.726515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 689/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:49.747499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:49.748130 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:49.754849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:49.755337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:49.755777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:49.756507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:49.756966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:49.757397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:49.820637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:49.828364 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dc5fe686-a887-4e16-b9d0-d22888d9c07c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084800 Sep 07 08:12:49.828919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 666/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:50.849839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:50.850455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:50.856966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:50.857450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:50.857883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:50.858573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:50.859031 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:50.859457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:50.927668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:50.935626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6791f110-db53-4596-a6e0-2c291171f4b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089774 Sep 07 08:12:50.936467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 690/1356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:51.959971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:51.960615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:51.967005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:51.967485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:51.967921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:51.968637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:51.969097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:51.969521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:52.032824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:52.040637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d33d7496-6ca5-41e7-a675-5f121d76ae29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085208 Sep 07 08:12:52.041195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 667/1357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:53.063333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:53.063927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:53.071158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:53.071635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:53.072070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:53.072800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:53.073255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:53.073675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:53.141301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:53.149035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e9779b1b-b97f-453e-b973-564cdf19790b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089819 Sep 07 08:12:53.149594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 691/1358] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:54.171613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:54.172264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:54.179299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:54.179785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:54.180262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:54.180959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:54.181416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:54.181843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:54.243505 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:54.251205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a87b5e26-078f-4378-acd9-4a8e6c15a7e4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083643 Sep 07 08:12:54.252146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 668/1359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:55.275051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:55.275659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:55.282092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:55.282570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:55.283000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:55.283694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:55.284210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:55.284633 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:55.345803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:55.353587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fe4aceb-474c-4049-996f-e6dd8ef8ee37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082504 Sep 07 08:12:55.354159 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 692/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:56.376717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:56.377369 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:56.384122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:56.384621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:56.385062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:56.385760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:56.386219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:56.386652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:56.448728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:56.457757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ee54e7eb-deec-450c-b029-7219b3ca3601 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084664 Sep 07 08:12:56.458412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 669/1361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:57.480642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:57.481252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:57.488286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:57.488772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:57.489204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:57.489895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:57.490345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:57.490770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:57.551499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:57.559155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d93ad703-d918-4f92-997d-c5fc8e0af8d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082520 Sep 07 08:12:57.559730 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 693/1362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:58.581124 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:58.581912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:58.584261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:58.589521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:58.589999 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:58.590430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:58.591145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:58.591592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:58.592019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:58.594704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:58.653587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:58.662498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aee854ac-2c40-43ea-b4dc-006c3f6dbc53 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085161 Sep 07 08:12:58.663264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 670/1363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:12:59.686672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:12:59.687256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:12:59.689562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:59.695636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:59.696144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:59.696585 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:59.697277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:12:59.697735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:12:59.698159 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:12:59.700715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:12:59.763806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:12:59.773088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e52727b1-db68-4244-996a-b0f4a8b465cf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.090667 Sep 07 08:12:59.773726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 694/1364] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:12:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:00.797625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:00.798232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:00.805332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:00.805810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:00.806238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:00.806926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:00.807374 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:00.807824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:00.873077 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:00.881494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8003f5fe-47b0-49fa-b178-307711b9ac41 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088490 Sep 07 08:13:00.882060 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 671/1365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:01.903778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:01.904462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:01.910975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:01.911459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:01.911895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:01.912626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:01.913083 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:01.913510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:01.974348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:01.981995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bbdb9c15-36dc-41f7-9cae-f297a5bc1181 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082073 Sep 07 08:13:01.982565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 695/1366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:03.005603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:03.006209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:03.012714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:03.013203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:03.013641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:03.014339 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:03.014800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:03.015230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:03.079075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:03.086958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-100bce48-5121-4cb5-8d4d-fc7e5c56b939 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086034 Sep 07 08:13:03.087467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 672/1367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:04.109554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:04.110202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:04.116799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:04.117286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:04.117721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:04.118413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:04.118865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:04.119293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:04.182322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:04.190669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96314c27-124f-43b0-a40c-bbb9f566c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084466 Sep 07 08:13:04.191338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 696/1368] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:05.213102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:05.213718 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:05.220275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:05.220764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:05.221204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:05.222870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:05.223341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:05.223776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:05.286924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:05.295085 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-15e27d41-0af4-455f-a3f9-e16c0d01d569 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085880 Sep 07 08:13:05.295646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 673/1369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:06.317417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:06.318026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:06.324518 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:06.324997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:06.325434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:06.326116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:06.326572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:06.326994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:06.387304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:06.395131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f8bd2a8-4e6d-47f1-a299-d586211fece9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081751 Sep 07 08:13:06.395711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 697/1370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:07.418429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:07.419045 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:07.425994 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:07.426478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:07.426921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:07.427613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:07.428073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:07.428526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:07.489144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:07.496717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7ebd0c5c-5949-48bf-bbf3-52f9079267ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082238 Sep 07 08:13:07.497281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 674/1371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:08.520449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:08.521048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:08.527505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:08.527985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:08.528448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:08.529133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:08.529584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:08.530007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:08.593984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:08.601883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e58f356-cbb1-4a9c-8066-d1b733027bb0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085991 Sep 07 08:13:08.602447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 698/1372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:09.624540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:09.625145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:09.631696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:09.632204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:09.632639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:09.633323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:09.633781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:09.634250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:09.697482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:09.705058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d9cdcf83-0554-4370-9f87-47b23cf1e91f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084329 Sep 07 08:13:09.706170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 675/1373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:10.730263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:10.730780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:10.737737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:10.738293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:10.738731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:10.739422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:10.739880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:10.740334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:10.801844 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:10.810342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24f054e9-550a-4bf2-bf92-a5e69cb414be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083983 Sep 07 08:13:10.810917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 699/1374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:11.834378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:11.834966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:11.841426 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:11.841913 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:11.842351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:11.843040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:11.843500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:11.843927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:11.905249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:11.913058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-01671a84-faf0-4db6-8996-8df87417efce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083345 Sep 07 08:13:11.913627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 676/1375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:12.934869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:12.935481 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:12.942549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:12.943038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:12.943479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:12.944201 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:12.944660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:12.945084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:13.009356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:13.017055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-58e8605d-0a73-4eef-9c82-93201e9c65f7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086047 Sep 07 08:13:13.017616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 700/1376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:14.041019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:14.041655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:14.048154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:14.048647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:14.049090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:14.050625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:14.051090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:14.051525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:14.114750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:14.122693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7b8145ec-e4fe-4e4a-8928-04f53f003ed9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085558 Sep 07 08:13:14.123195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 677/1377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:15.146641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:15.147284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:15.153890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:15.154373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:15.154803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:15.155491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:15.155941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:15.156422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:15.216605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:15.224491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dacb0987-33f4-41be-b020-b77eefea94ec tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082504 Sep 07 08:13:15.225048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 701/1378] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:16.246908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:16.247609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:16.254178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:16.254817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:16.255277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:16.255974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:16.256462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:16.256896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:16.318248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:16.325931 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-42272b6b-5679-4d5d-92e1-3daf2806bfa1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082839 Sep 07 08:13:16.326495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 678/1379] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:17.348976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:17.349562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:17.356060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:17.356564 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:17.356995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:17.357675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:17.358127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:17.358548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:17.422376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:17.430249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-008e1e70-c93e-4d9a-b762-fcfab9ca32dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085966 Sep 07 08:13:17.430808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 702/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:18.453153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:18.453760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:18.460424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:18.460928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:18.461468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:18.461998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:18.462445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:18.462867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:18.526521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:18.534295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-10553bcb-bd3f-4f55-8be9-40163bda169f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084978 Sep 07 08:13:18.535011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 679/1381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:19.557662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:19.558219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:19.564808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:19.565289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:19.565717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:19.567144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:19.567688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:19.568131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:19.630774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:19.638313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-40074a19-0d94-43ec-8d42-8610eae53dcc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084547 Sep 07 08:13:19.638874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 703/1382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:20.661402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:20.661976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:20.668400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:20.668887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:20.669325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:20.670018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:20.670472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:20.670899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:20.731838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:20.739739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e0f21294-8f71-446a-a8f0-52e379fbe9a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082596 Sep 07 08:13:20.740329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 680/1383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:21.763655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:21.764224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:21.771879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:21.772400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:21.772843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:21.773538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:21.773993 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:21.774417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:21.836319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:21.844003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05d0926a-26bd-4d42-b324-5ad487ec1c09 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084770 Sep 07 08:13:21.844591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 704/1384] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:22.867838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:22.868491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:22.870531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:13:22.870667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:13:22.878013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:22.878525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:22.878977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:22.879666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:22.880151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:22.880579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:22.942309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:22.949974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-93ef55d6-059b-4c27-aac4-05bde312b9be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087060 Sep 07 08:13:22.950532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 681/1385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:23.972675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:23.973667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:23.980110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:23.980594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:23.981027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:23.981704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:23.982160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:23.982576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:24.045745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:24.053991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eab901b6-4e1c-4645-af25-76f625b2acd7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085349 Sep 07 08:13:24.054553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 705/1386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:25.077665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:25.078243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:25.085378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:25.085865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:25.086296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:25.086988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:25.087462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:25.087866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:25.152248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:25.159880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-02dcb0f1-f2fa-4dc6-ba15-d57822ccd9a9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086330 Sep 07 08:13:25.160461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 682/1387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:26.182351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:26.182947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:26.189543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:26.190026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:26.190454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:26.191290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:26.191990 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:26.192448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:26.256805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:26.264877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-49026dac-42be-47b3-83a8-2f7533e5a7c6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086326 Sep 07 08:13:26.265642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 706/1388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:27.288605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:27.289192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:27.295602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:27.296132 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:27.296568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:27.297274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:27.297724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:27.298147 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:27.361830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:27.370161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-113af2d0-0127-4670-8e2a-a531dc131d18 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086083 Sep 07 08:13:27.370725 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 683/1389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:28.391956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:28.392598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:28.399756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:28.400285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:28.400725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:28.401425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:28.401881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:28.402307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:28.470074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:28.477913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a69ee8ef-e555-4880-8609-8bef14d14595 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089833 Sep 07 08:13:28.478479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 707/1390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:29.500204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:29.500721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:29.503007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:13:29.508757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:29.509238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:29.509670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:29.510349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:29.510798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:29.511216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:29.515213 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:13:29.572054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:29.579493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-87808a31-7daa-485e-9aef-71e569b110fe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083196 Sep 07 08:13:29.580055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 684/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:30.602745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:30.603354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:30.605771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:13:30.611134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:30.611618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:30.612055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:30.612774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:30.613225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:30.613650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:30.616348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:13:30.676803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:30.684485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3d52b3ab-49b9-42f4-b29a-3ac7402a39be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085613 Sep 07 08:13:30.685044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 708/1392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:31.706905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:31.707517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:31.714000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:31.714482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:31.714911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:31.715596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:31.716046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:31.716491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:31.792299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:31.799912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-040a3a2c-0169-4ea4-be80-c583ef4ceb71 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.097060 Sep 07 08:13:31.801264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 685/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:32.823796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:32.824354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:32.831823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:32.832344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:32.832783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:32.833484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:32.833946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:32.834374 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:32.900045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:32.907887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f456bc5a-87fe-4b83-ae2e-bf4b62502634 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087999 Sep 07 08:13:32.908578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 709/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:32 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:33.930926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:33.931537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:33.938386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:33.938863 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:33.939294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:33.939971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:33.940471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:33.940942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:34.003802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:34.011511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8a902250-d633-4483-80fd-acc453e903c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084410 Sep 07 08:13:34.012074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 686/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:35.035043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:35.035766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:35.042180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:35.042667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:35.043109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:35.043800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:35.044295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:35.044727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:35.109279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:35.117384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4ff5a1de-75a2-4d57-8fa3-2c29c7822ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086807 Sep 07 08:13:35.118087 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 710/1396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:36.140976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:36.141921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:36.148838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:36.149332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:36.149771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:36.150464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:36.150920 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:36.151347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:36.215103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:36.223652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a4890f9f-69b0-47d6-b7c4-6cb8f7db2746 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086651 Sep 07 08:13:36.224234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 687/1397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:37.246831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:37.247430 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:37.254109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:37.254594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:37.255045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:37.255743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:37.256237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:37.256669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:37.317359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:37.325062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-813c9776-ee58-4eed-a02c-f5cd04522f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082174 Sep 07 08:13:37.325627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 711/1398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:38.348673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:38.350642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:38.356073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:38.356580 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:38.357014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:38.357700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:38.358154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:38.358577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:38.420189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:38.428302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a103d427-96ea-4a75-a31f-cd5462431f3b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084203 Sep 07 08:13:38.428854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 688/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:39.451449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:39.452099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:39.458836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:39.459321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:39.459755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:39.460480 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:39.460939 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:39.461367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:39.521747 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:39.529292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a93f1c0f-ccc6-494e-963d-d9c9da2de9ab tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081759 Sep 07 08:13:39.529861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 712/1400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:40.551871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:40.552515 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:40.558866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:40.559345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:40.559776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:40.560482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:40.560933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:40.561616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:40.624256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:40.632776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ef50fcfd-830d-4ab9-bf62-5713f3aac768 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085240 Sep 07 08:13:40.633324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 689/1401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:41.654344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:41.654915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:41.661604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:41.662090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:41.662529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:41.663224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:41.663678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:41.664122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:41.725237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:41.732882 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-08b4ad37-b73f-4164-9fed-f6bd45a2bb34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082536 Sep 07 08:13:41.733443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 713/1402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:42.755540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:42.756142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:42.762834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:42.763323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:42.763763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:42.764501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:42.764959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:42.765385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:42.826444 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:42.834706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c7f119d2-7275-417d-bc5a-10f42fc4925d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083102 Sep 07 08:13:42.835273 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 690/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:43.860195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:43.860796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:43.867246 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:43.867725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:43.868179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:43.868864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:43.869314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:43.869732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:43.932977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:43.941408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ab79d5c-dc0e-4f84-a8b9-9017137dd318 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085106 Sep 07 08:13:43.941934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 714/1404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:44.964519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:44.965107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:44.971549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:44.972176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:44.972693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:44.973384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:44.973834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:44.974253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:45.039467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:45.047067 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bcb98ed0-5fc7-4d44-b645-c1215a333cad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086396 Sep 07 08:13:45.047619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 691/1405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:46.070337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:46.070977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:46.077389 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:46.077868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:46.078301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:46.078990 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:46.079440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:46.079859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:46.140947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:46.148783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1fbe4e49-ae5b-4a7e-a786-2dc90b97584a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082374 Sep 07 08:13:46.149349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 715/1406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:47.171186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:47.171791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:47.178776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:47.179282 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:47.179718 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:47.180424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:47.180876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:47.181294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:47.244363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:47.251907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b910ccb-a6dc-4dc7-98d1-9821850f9fce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084641 Sep 07 08:13:47.252498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 692/1407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:48.274943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:48.275540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:48.281997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:48.282479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:48.282916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:48.283607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:48.284645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:48.285070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:48.348029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:48.355663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a77a1cf4-8a80-4e01-8cf9-7cf35408148e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084672 Sep 07 08:13:48.356256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 716/1408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:49.379555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:49.380217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:49.387306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:49.387801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:49.388343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:49.389109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:49.389574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:49.390004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:49.453084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:49.461193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f86f6b79-e202-4008-8c26-47398c2d080c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086244 Sep 07 08:13:49.461759 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 693/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:50.483643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:50.484307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:50.491669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:50.492179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:50.492675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:50.493362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:50.493813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:50.494234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:50.555104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:50.563121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-07420377-6835-4bf0-a7c7-3d15fa8b86f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083380 Sep 07 08:13:50.563694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 717/1410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:51.586088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:51.586860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:51.593164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:51.593646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:51.594120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:51.594760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:51.595237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:51.595631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:51.656805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:51.665227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4ac73c86-7727-4fa6-9265-4283a83411eb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083022 Sep 07 08:13:51.665780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 694/1411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:52.687849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:52.688429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:52.694658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:52.695141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:52.695604 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:52.696326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:52.696786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:52.697213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:52.759450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:52.767204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cdb95092-8a56-4278-aebe-10fd3180fc12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083651 Sep 07 08:13:52.767764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 718/1412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:53.790128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:53.790682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:53.796830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:53.797315 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:53.797787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:53.798479 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:53.798936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:53.799999 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:53.864013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:53.871776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c2f9d437-5db5-4cef-84db-722035c67c44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085828 Sep 07 08:13:53.872278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 695/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:54.895450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:54.896056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:54.902459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:54.902943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:54.903382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:54.904070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:54.904546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:54.904971 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:54.967039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:54.974968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b7b088b9-f9fd-48db-a0f4-e271b4408b9f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084067 Sep 07 08:13:54.975536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 719/1414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:55.996695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:55.997309 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:56.004254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:56.004738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:56.005171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:56.005860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:56.006318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:56.006743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:56.069202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:56.076932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-12bab3eb-28ba-4053-893a-5ecc3450ff70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084190 Sep 07 08:13:56.077489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 696/1415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:57.099928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:57.100813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:57.108510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:57.108989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:57.109428 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:57.110114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:57.110565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:57.110986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:57.173202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:57.181465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae85f996-f779-49aa-99b5-3c72c680d7f3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085986 Sep 07 08:13:57.182044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 720/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:58.204410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:58.205009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:58.212449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:58.212936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:58.213375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:58.214070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:58.214560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:58.214992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:58.278356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:58.286298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1d6ca064-c4ef-4aef-9e71-c35adbd88806 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085853 Sep 07 08:13:58.286855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 697/1417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:13:59.309498 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:13:59.310108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:13:59.317323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:59.317804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:59.318235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:59.318919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:13:59.319369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:13:59.319790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:13:59.380142 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:13:59.387863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ef8df17c-60b0-4182-9cf3-76f4ff2b0dbc tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082276 Sep 07 08:13:59.388451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 721/1418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:13:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:00.410785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:00.411422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:00.413846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:00.419255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:00.419743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:00.420211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:00.420910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:00.421366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:00.421791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:00.426831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:00.482959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:00.491773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5d128b7d-ed23-42d1-b0f6-fc8aa755a236 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085386 Sep 07 08:14:00.492413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 698/1419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:01.515032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:01.515633 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:01.518058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:01.523361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:01.523841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:01.524301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:01.524984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:01.525432 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:01.525851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:01.528535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:01.590270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:01.598583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f9bd1589-45b1-4026-9d11-4699232a1725 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087874 Sep 07 08:14:01.599149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 722/1420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:02.621573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:02.622179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:02.629378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:02.629859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:02.630300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:02.630984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:02.631439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:02.631866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:02.695743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:02.703350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2acbe66a-4b9c-451e-aa64-a365dd4d7db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085652 Sep 07 08:14:02.703902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 699/1421] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:03.727230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:03.727781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:03.734235 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:03.734724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:03.735158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:03.735849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:03.736338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:03.736866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:03.798867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:03.806695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4f3dbd16-6623-4505-91ed-552548d90e46 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083458 Sep 07 08:14:03.807256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 723/1422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:04.829118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:04.829679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:04.836149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:04.836634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:04.837061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:04.837743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:04.838193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:04.838610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:04.900858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:04.908489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7308f045-0803-41c9-a0b0-4da44c7ba0c1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083255 Sep 07 08:14:04.909570 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 700/1423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:14:05.931323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:05.931987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:05.938805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:05.939290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:05.939728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:05.941104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:05.941563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:05.941990 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:06.002230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:06.010576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1bf7fb38-3877-4b7e-b3b6-8ae459a003e3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083160 Sep 07 08:14:06.011137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 724/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:07.033161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:07.033801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:07.040257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:07.040740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:07.041174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:07.041865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:07.042347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:07.042775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:07.104222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:07.112391 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-369e7de9-3067-4665-bc24-624ef6125ec0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083091 Sep 07 08:14:07.112951 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 701/1425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:08.134886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:08.135520 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:08.142005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:08.142491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:08.142927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:08.144417 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:08.144850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:08.145279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:08.205371 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:08.213450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-984c8586-16b3-45f9-8a4b-50cd2e16ea69 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082471 Sep 07 08:14:08.214020 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 725/1426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:09.236801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:09.237978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:09.244302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:09.244780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:09.245245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:09.245926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:09.246379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:09.246804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:09.307563 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:09.315669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ada20851-dfb2-4618-8fa5-61ee0bafb06d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082787 Sep 07 08:14:09.316265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 702/1427] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:10.338086 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:10.338641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:10.344926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:10.345403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:10.345835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:10.346578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:10.347056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:10.347475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:10.410988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:10.418906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9243ce50-ad3a-4f64-b7f6-c012a73e2b55 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084789 Sep 07 08:14:10.419474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 726/1428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:11.443189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:11.443792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:11.450284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:11.450760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:11.451188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:11.451866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:11.452344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:11.452770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:11.517127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:11.525430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ce9b2718-4dd4-4be8-89de-e840255f79d5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086815 Sep 07 08:14:11.525984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 703/1429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:12.547798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:12.548435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:12.554995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:12.555484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:12.555922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:12.556647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:12.557105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:12.557529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:12.619094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:12.626828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab39d018-ed3f-4502-998d-38edd2ca4d0b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082926 Sep 07 08:14:12.627392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 727/1430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:13.649790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:13.650396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:13.656774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:13.657249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:13.657679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:13.658359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:13.658856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:13.659428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:13.721942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:13.729527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-146cbefd-afcb-4c3e-945a-3b1b33ae2df8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083619 Sep 07 08:14:13.730078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 704/1431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:14.751835 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:14.752507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:14.758925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:14.759385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:14.759813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:14.760525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:14.760976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:14.761402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:14.822358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:14.830027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5f4004ad-14fe-4cb9-a35a-b6cb8fa3faca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082118 Sep 07 08:14:14.831148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 728/1432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:15.853734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:15.854280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:15.860719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:15.861206 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:15.861643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:15.862620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:15.863074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:15.863504 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:15.923765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:15.931923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-31730930-f5b2-4082-96f7-8a5d4190a048 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082295 Sep 07 08:14:15.932513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 705/1433] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:16.956499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:16.957110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:16.963507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:16.963992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:16.964467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:16.965188 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:16.965645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:16.966070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:17.029005 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:17.037206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1b8075ba-fe4e-405f-bbe1-35bb0acfd223 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084907 Sep 07 08:14:17.037771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 729/1434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:18.058748 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:18.059366 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:18.067367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:18.067856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:18.068324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:18.069019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:18.069482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:18.069912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:18.131524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:18.139240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-79a89f60-c4d9-4116-95dc-b0e23049c1e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084394 Sep 07 08:14:18.139801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 706/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:19.161125 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:19.161720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:19.168097 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:19.168580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:19.169006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:19.169689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:19.170140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:19.170562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:19.240932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:19.248913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-24b9533f-7d46-4bbd-9d9d-ff264f51cb76 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.091662 Sep 07 08:14:19.249472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 730/1436] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:19.714770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:19.715261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:19.721710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:19.722225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:19.722928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:19.723688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:19.724187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:19.724624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:19.749188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:14:19.798277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.compute.api [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Instance is already in deleting state, ignoring this request Sep 07 08:14:19.799091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-48fd2822-d467-4d33-9b6e-445185ce6bce tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 204 len: 0 microversion: 2.1 time: 0.088193 Sep 07 08:14:19.799649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 707/1437] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:14:19 2022] DELETE /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:14:19.807979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:19.808698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:19.814775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:19.815255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:19.815683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:19.816884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:19.817333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:19.817749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:19.879136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:19.886795 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-616fec2d-9459-4920-a40d-c46e5b76951a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082621 Sep 07 08:14:19.887360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 731/1438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:20.910996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:20.911662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:20.917991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:20.918471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:20.918911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:20.919598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:20.920056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:20.920504 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:20.983624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:20.991983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-428a5449-f52a-4489-8892-a3977e506ac1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085675 Sep 07 08:14:20.992574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 708/1439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:14:22.014151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:22.014751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:22.020839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:22.021319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:22.021752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:22.022444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:22.022901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:22.023353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:22.083492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:22.091156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ffd09122-2933-4a36-ad98-e8620f073261 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081035 Sep 07 08:14:22.091724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 732/1440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:23.114614 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:23.115196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:23.121711 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:23.122198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:23.122636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:23.123331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:23.123794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:23.124264 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:23.184333 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:23.192539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6cd8c813-f093-4f9b-9443-c1ffcb9bd8fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082383 Sep 07 08:14:23.193102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 709/1441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:14:24.214891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:24.215510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:24.222074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:24.222557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:24.223018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:24.223711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:24.224194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:24.224622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:24.287973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:24.295702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-81478914-6251-487a-a8bd-23e67b430f1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084714 Sep 07 08:14:24.296291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 733/1442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:25.319248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:25.319905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:25.327907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:25.328422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:25.328859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:25.329587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:25.330044 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:25.330469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:25.391538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:25.399904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d2cd6ef3-f6e0-4c3c-9ec7-0aaea1165b77 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085004 Sep 07 08:14:25.400492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 710/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:26.423027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:26.423612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:26.430251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:26.430732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:26.431162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:26.431846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:26.432327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:26.432752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:26.495951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:26.503657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-511d2972-fa6b-4fea-aa12-bcc26e56eb40 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084776 Sep 07 08:14:26.504241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 734/1444] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:27.526236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:27.526848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:27.533571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:27.534068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:27.534503 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:27.535207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:27.535668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:27.536254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:27.611272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:27.620441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-61829c27-1fd9-4a1b-ba3c-f331a98ba04f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.097765 Sep 07 08:14:27.621371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 711/1445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:14:28.643686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:28.644255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:28.650624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:28.651102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:28.651528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:28.652246 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:28.652700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:28.653119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:28.713819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:28.721407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd80ba46-544d-4d8e-909d-b80b751eb354 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081644 Sep 07 08:14:28.721967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 735/1446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:29.744235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:29.744774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:29.751178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:29.751663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:29.752119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:29.752811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:29.753270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:29.753697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:29.819347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:29.827034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f9d47ee9-cb67-44b6-a57b-4414acb11c06 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086818 Sep 07 08:14:29.827596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 712/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:30.849802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:30.850413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:30.856798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:30.857282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:30.857716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:30.858404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:30.858859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:30.859282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:30.920400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:30.928609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e911ac7-d64d-4a1c-a825-2a90d7c2d84f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082683 Sep 07 08:14:30.929172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 736/1448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:31.953753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:31.954351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:31.956730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=30 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:31.964003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:31.964517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:31.964953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:31.966004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:31.966480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:31.966900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:31.970082 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:32.030630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:32.038648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6167f48c-4b95-4559-b7d3-299c2e7764fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088714 Sep 07 08:14:32.039220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 713/1449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:33.060564 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:33.061843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:33.064182 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=30 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:33.069620 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:33.070109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:33.070552 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:33.071247 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:33.071708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:33.072164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:33.076227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=90 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:14:33.137827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:33.145466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9c174629-27df-40ac-bb94-879f5e1c1c80 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088959 Sep 07 08:14:33.146522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 737/1450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:34.168517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:34.169126 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:34.175629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:34.176131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:34.176575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:34.177762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:34.178360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:34.178784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:34.240336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:34.247900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bf48ceea-a937-4d23-8391-8692fc58d2ed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083258 Sep 07 08:14:34.248477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 714/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:35.270655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:35.271950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:35.278540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:35.279026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:35.279466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:35.280196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:35.280661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:35.281100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:35.342098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:35.349941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12046ff3-e0fc-46aa-8c5d-0ba3b8a04600 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083161 Sep 07 08:14:35.350544 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 738/1452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:36.373062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:36.373690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:36.380548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:36.381047 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:36.381491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:36.382200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:36.382659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:36.383086 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:36.446992 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:36.454682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e49e9091-fe1c-4877-aedb-50101858c6ff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085524 Sep 07 08:14:36.455230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 715/1453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:37.478478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:37.479085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:37.485573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:37.486059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:37.486493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:37.487180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:37.487634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:37.488058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:37.548772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:37.557300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5e7eca56-8a47-4978-b613-d44eb8a126b5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083208 Sep 07 08:14:37.557872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 739/1454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:38.579705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:38.580335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:38.586818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:38.587296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:38.587726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:38.588442 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:38.588891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:38.589311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:38.653270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:38.660868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-df656507-2fea-4b2e-b454-d0ac6a17600a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084991 Sep 07 08:14:38.661575 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 716/1455] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:39.685058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:39.685673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:39.692392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:39.692879 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:39.693320 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:39.694014 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:39.694474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:39.694995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:39.757010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:39.765266 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b328a0b-d298-4a0d-ae2b-ccfb837c8ec3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084085 Sep 07 08:14:39.765833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 740/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:40.788708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:40.789237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:40.796254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:40.796738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:40.797170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:40.797861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:40.798317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:40.798742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:40.860290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:40.867964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f5e64220-60a0-4ba2-919c-8ca59e728763 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083227 Sep 07 08:14:40.868545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 717/1457] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:41.890492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:41.891105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:41.897661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:41.898140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:41.898573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:41.899908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:41.900312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:41.900739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:41.964599 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:41.972339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7128699a-2a4d-44da-ac3c-da7e5e2ad351 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085654 Sep 07 08:14:41.972900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 741/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:42.995738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:42.996474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:43.003701 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:43.004287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:43.004822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:43.005602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:43.006120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:43.006605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:43.071693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:43.079343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-86e89e0a-4f94-4ab5-8c6b-a454c338a3a4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088327 Sep 07 08:14:43.079905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 718/1459] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:44.102940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:44.103578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:44.110131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:44.110624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:44.111067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:44.111764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:44.112255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:44.112686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:44.173594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:44.181993 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-184a70a8-4690-44eb-9441-a0019c31faad tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083497 Sep 07 08:14:44.182565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 742/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:45.204790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:45.205395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:45.212459 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:45.212935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:45.213365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:45.214043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:45.214487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:45.214906 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:45.276928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:45.284554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8473cd85-4416-4ee9-8ecf-033fdc2d66a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083592 Sep 07 08:14:45.285108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 719/1461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:46.307484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:46.308112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:46.314971 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:46.315457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:46.315926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:46.316658 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:46.318007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:46.318007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:46.381259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:46.389181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-451bd008-2552-49af-9e56-a3112264478a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086261 Sep 07 08:14:46.389948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 743/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:14:47.620660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:47.621313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:47.627199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:47.627681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:47.628142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:47.628833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:47.629288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:47.629713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:47.693235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:47.701163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-17d3c5d7-f73b-427e-be5b-21502c7fd0d2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.293324 Sep 07 08:14:47.701715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 720/1463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:48.723334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:48.723870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:48.730296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:48.730771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:48.731195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:48.731878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:48.732350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:48.732767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:48.793139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:48.800710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a8cbda63-0cea-4938-b15f-98c8b36de2b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081271 Sep 07 08:14:48.801263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 744/1464] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:49.823923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:49.824522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:49.830892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:49.831370 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:49.831800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:49.832508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:49.833013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:49.833440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:49.893596 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:49.902202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c5f1b221-670f-4860-9179-ddf94195da34 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082757 Sep 07 08:14:49.902758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 721/1465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:50.924885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:50.925530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:50.932339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:50.932824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:50.933262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:50.933950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:50.934412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:50.934854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:50.998262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:51.006045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b905f0b4-6f0c-4343-a4b3-df7308aa2eff tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084993 Sep 07 08:14:51.006545 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 745/1466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:52.029110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:52.029794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:52.036150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:52.036640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:52.037075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:52.037766 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:52.038226 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:52.038656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:52.101176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:52.110192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ced19cb3-930e-48e2-8a6e-506ef81f857b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085172 Sep 07 08:14:52.110753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 722/1467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:53.133460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:53.134012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:53.140867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:53.141344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:53.141770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:53.142455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:53.142901 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:53.143317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:53.204166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:53.211659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d96897f2-21b9-44f3-be6e-c610b9884f68 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082161 Sep 07 08:14:53.212292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 746/1468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:54.235064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:54.235673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:54.241793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:54.242277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:54.242713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:54.243399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:54.243858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:54.244308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:54.304371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:54.312137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c7a1d841-8f40-48f8-b07e-d23880ccb535 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.080964 Sep 07 08:14:54.312705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 723/1469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:55.334761 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:55.335356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:55.341851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:55.342340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:55.342778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:55.343470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:55.343929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:55.344384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:55.405308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:55.413323 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9d8842e-c043-461d-a06a-f93f08acff44 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082453 Sep 07 08:14:55.413892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 747/1470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:56.437285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:56.437896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:56.444381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:56.444864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:56.445297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:56.446013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:56.446466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:56.446895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:56.509439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:56.517885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7224901e-ad6c-42a7-b332-01f265ae0a26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084689 Sep 07 08:14:56.518449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 724/1471] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:57.540400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:57.541134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:57.547694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:57.548208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:57.548649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:57.549343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:57.549805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:57.550234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:57.612797 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:57.620902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1c0c9036-52cf-4372-b306-d329c11d1b7c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084466 Sep 07 08:14:57.621474 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 748/1472] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:58.643958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:58.644537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:58.651090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:58.651579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:58.652007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:58.652718 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:58.654457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:58.654457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:58.714993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:58.722564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2a8e525b-af9c-4998-a75a-d575eeca046a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082672 Sep 07 08:14:58.723117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 725/1473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:14:59.745701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:14:59.746241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:14:59.752623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:59.753109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:59.753548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:59.754238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:14:59.754761 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:14:59.755198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:14:59.819241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:14:59.827071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16d61459-e639-4ff0-ab16-9771a6206c28 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085422 Sep 07 08:14:59.827635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 749/1474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:14:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:00.849329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:00.849941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:00.856417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:00.856899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:00.857336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:00.858027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:00.858484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:00.858911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:00.919871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:00.927794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fc79efe2-e02e-44cd-90be-0c559dd821e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082282 Sep 07 08:15:00.928387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 726/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:01.951547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:01.952181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:01.954577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:15:01.954719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:15:01.955742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:15:01.955859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:15:01.956737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:15:01.956860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:15:01.965571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:01.966060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:01.966498 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:01.967195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:01.967651 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:01.968097 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:02.033535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:02.041420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fce05cb-fccc-4e78-8bd1-5391bb477f26 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.094550 Sep 07 08:15:02.041992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 750/1476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:03.064237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:03.064853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:03.067593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:15:03.067721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:15:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:15:03.069414 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:03.080899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:03.081393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:03.081834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:03.082540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:03.083009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:03.083439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:03.089396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:03.146198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:03.154368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7ae4ea77-6d25-4e98-a732-a0b16942ae89 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.094266 Sep 07 08:15:03.154928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 727/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:04.177198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:04.177813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:04.180129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:04.186016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:04.186542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:04.186986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:04.187688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:04.188180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:04.188614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:04.191265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:04.249870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:04.257721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6b9f69a0-722a-45e0-aa0d-9380315ebd2d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084379 Sep 07 08:15:04.258288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 751/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:05.281710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:05.282301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:05.288775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:05.289259 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:05.289695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:05.290376 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:05.291696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:05.292148 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:05.355781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:05.363511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eb9623e0-852f-4e2b-a272-b214ad5337fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085706 Sep 07 08:15:05.364091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 728/1479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:06.385627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:06.386249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:06.392777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:06.393262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:06.393709 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:06.394401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:06.394861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:06.395290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:06.456559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:06.464486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f6cd5a04-85ea-4db0-9f90-2eed7527ba59 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083057 Sep 07 08:15:06.465054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 752/1480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:07.487281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:07.487883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:07.494871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:07.495345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:07.495772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:07.496478 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:07.496928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:07.497350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:07.559443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:07.567404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-904397f9-2cd3-44a4-8fd1-63d53a4a6792 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083934 Sep 07 08:15:07.567962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 729/1481] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:08.591523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:08.592149 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:08.598635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:08.599116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:08.599547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:08.600268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:08.600721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:08.601385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:08.664514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:08.672355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-037cb692-6c4b-42c7-ad8a-f1790005eeed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085433 Sep 07 08:15:08.672914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 753/1482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:09.695162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:09.695723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:09.702119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:09.702608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:09.703041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:09.703726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:09.704205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:09.704631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:09.764471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:09.772068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1460c329-ff11-4cb9-aa9b-991069f2fb7d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.080903 Sep 07 08:15:09.772664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 730/1483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:10.796526 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:10.797702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:10.804508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:10.805002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:10.805446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:10.806819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:10.807429 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:10.807894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:10.869960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:10.877643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1bb701ff-e609-4a9b-9db1-36f94272ab82 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085006 Sep 07 08:15:10.878204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 754/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:15:11.900747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:11.901356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:11.907789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:11.908314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:11.908753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:11.909443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:11.909902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:11.910356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:11.974326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:11.982357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fb7c5e2f-a0aa-4e45-8b7e-ac9681209ba2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086163 Sep 07 08:15:11.982912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 731/1485] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:13.005605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:13.006252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:13.012842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:13.013331 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:13.013770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:13.014464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:13.014922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:13.015354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:13.077045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:13.084627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-185d7603-73b2-4bbc-827c-8436c0788ed6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083001 Sep 07 08:15:13.085197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 755/1486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:14.108685 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:14.109301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:14.116452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:14.116929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:14.117359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:14.118041 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:14.119119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:14.119546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:14.185092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:14.193013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7dac160a-63b7-4e43-b7b2-c942c3f554f6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088163 Sep 07 08:15:14.193562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 732/1487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:15.214559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:15.215168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:15.221619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:15.222103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:15.222539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:15.223228 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:15.223683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:15.224130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:15.286500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:15.294642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0d1a140b-8e8a-4a45-a286-42c571ba4b60 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083998 Sep 07 08:15:15.295202 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 756/1488] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:16.317387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:16.317989 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:16.324855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:16.325329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:16.325799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:16.326498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:16.326970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:16.327390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:16.518322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:16.526176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-702e2010-f193-45a1-a193-de5b3ca6d037 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.212440 Sep 07 08:15:16.526606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 733/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:17.548587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:17.549191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:17.555557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:17.556130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:17.556649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:17.557343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:17.557826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:17.558246 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:17.621563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:17.629165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7c61bd6b-3c06-4f2e-8979-84d6f6aa52de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084432 Sep 07 08:15:17.629723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 757/1490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:18.652985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:18.653574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:18.660028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:18.660540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:18.660969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:18.661647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:18.662100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:18.662517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:18.724624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:18.732895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c3d2596e-1522-414d-9f9d-d3639469d4a3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084462 Sep 07 08:15:18.733449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 734/1491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:19.755327 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:19.756057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:19.763411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:19.763894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:19.764351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:19.765035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:19.765488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:19.765907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:19.827156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:19.835059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a69e91c-754b-4707-b343-9459b8298e83 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083666 Sep 07 08:15:19.835614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 758/1492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:15:20.857338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:20.857953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:20.864401 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:20.864881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:20.865316 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:20.866006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:20.866464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:20.866885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:20.928073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:20.936896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a8835181-e9e0-4bbf-9ab0-629b0a599f8d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083462 Sep 07 08:15:20.937467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 735/1493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:21.960787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:21.961426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:21.968014 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:21.968525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:21.968956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:21.969641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:21.970091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:21.970512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:22.031066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:22.038665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c1328205-f7fa-4398-a038-4129388c1ba0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081953 Sep 07 08:15:22.039223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 759/1494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:23.062133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:23.062778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:23.069150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:23.069635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:23.070073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:23.070761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:23.071217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:23.071642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:23.135464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:23.143134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc9947a8-7f62-4cd2-9045-3d97d4366611 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086051 Sep 07 08:15:23.143698 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 736/1495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:24.165968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:24.166798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:24.173027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:24.173515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:24.173955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:24.174649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:24.175110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:24.175538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:24.295296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:24.303000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-73541262-d339-4946-804c-e11abb702ae2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.140980 Sep 07 08:15:24.303559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 760/1496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:25.327490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:25.328135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:25.334297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:25.334780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:25.335217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:25.335907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:25.336393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:25.336822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:25.399137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:25.407917 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc7ea159-5f96-4941-a900-650bce3b6337 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085237 Sep 07 08:15:25.408511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 737/1497] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:26.430774 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:26.431393 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:26.438112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:26.438600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:26.439043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:26.439735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:26.440229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:26.440661 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:26.504463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:26.512785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bd309f36-8659-4b17-afa9-17c37260069a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085876 Sep 07 08:15:26.513352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 761/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:27.535732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:27.536393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:27.543403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:27.543889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:27.544359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:27.545080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:27.545535 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:27.545960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:27.607293 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:27.614910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3f963848-ed39-4db0-8a7f-55fa0c49c49d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083056 Sep 07 08:15:27.615467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 738/1499] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:28.638034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:28.638582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:28.645163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:28.645646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:28.646077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:28.646771 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:28.647223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:28.647643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:28.710993 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:28.719391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85a57ca3-66f9-4b44-9adc-208e7c7efa0f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085507 Sep 07 08:15:28.719949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 762/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:29.742704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:29.743317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:29.749874 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:29.750357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:29.750794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:29.751489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:29.751941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:29.752396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:29.813786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:29.821521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c815fbfb-8d04-4beb-b91c-78343e4ba786 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082765 Sep 07 08:15:29.822083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 739/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:15:30.845120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:30.845667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:30.852204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:30.852691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:30.853135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:30.853832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:30.854296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:30.854900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:30.919496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:30.927462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df031446-2d65-48bd-a399-ce91069ce0db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086270 Sep 07 08:15:30.928038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 763/1502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:31.950411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:31.951026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:31.957490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:31.957969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:31.958408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:31.959120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:31.959583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:31.960008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:32.023476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:32.031419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a21366e3-6338-4fdb-8012-14bc77f92923 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084878 Sep 07 08:15:32.032006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 740/1503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:33.054953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:33.055547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:33.062693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:33.063206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:33.063638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:33.064349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:33.064799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:33.065221 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:33.125987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:33.133558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cae0e424-f163-4a31-b2cc-ebaa42e01071 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082479 Sep 07 08:15:33.134114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 764/1504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:34.157252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:34.157858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:34.160192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:34.165764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:34.166249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:34.166688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:34.167463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:34.167923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:34.168380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:34.170985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:34.246286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:34.254084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-003ecc93-bfa0-49c2-849c-42d2deb74abb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.100864 Sep 07 08:15:34.254649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 741/1505] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:35.278119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:35.278760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:35.281224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:35.287185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:35.287679 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:35.288146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:35.288847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:35.289308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:35.289739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:35.293222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:15:35.356398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:35.364196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d2b391d-9fae-4030-bae9-ba6b6aac894c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.090499 Sep 07 08:15:35.364770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 765/1506] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:36.387667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:36.388340 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:36.394720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:36.395204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:36.395639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:36.396353 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:36.396812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:36.397237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:36.458244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:36.465991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d6b3d384-b7ea-4983-9cf3-a35712b23a2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082329 Sep 07 08:15:36.466550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 742/1507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:37.489186 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:37.489794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:37.496758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:37.497234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:37.497666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:37.498351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:37.498800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:37.499228 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:37.559529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:37.567311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-537db2d7-6abf-4462-a13f-f11b0568ed45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082022 Sep 07 08:15:37.567868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 766/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:38.591438 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:38.592469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:38.601871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:38.602365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:38.602799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:38.603507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:38.603958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:38.604406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:38.674351 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:38.682113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5d6c8370-57a1-4d64-aec1-1f88cba1138f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.095838 Sep 07 08:15:38.687332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 743/1509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:39.705082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:39.705624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:39.712022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:39.712535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:39.712970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:39.713653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:39.714638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:39.715067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:39.774907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:39.783091 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-57a6d533-f528-453e-b3d0-00692576ab62 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081924 Sep 07 08:15:39.783647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 767/1510] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:40.805566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:40.806125 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:40.813568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:40.814053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:40.814482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:40.815172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:40.815653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:40.816172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:40.881197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:40.889090 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-48857a29-23fd-4d85-a2fd-8643ee5b586f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087417 Sep 07 08:15:40.889647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 744/1511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:41.912263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:41.912809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:41.921288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:41.922175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:41.922630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:41.923406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:41.924234 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:41.924680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:41.987675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:41.995988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-85601206-e95d-45d6-ab3d-d8b1c78fff21 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087201 Sep 07 08:15:41.996615 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 768/1512] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:43.018373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:43.018987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:43.025483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:43.025971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:43.027064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:43.027853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:43.028342 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:43.028771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:43.088747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:43.096959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc0f0caa-8052-468b-a978-ccc26df8aa10 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082490 Sep 07 08:15:43.097522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 745/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:44.119551 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:44.120825 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:44.127357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:44.127840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:44.128316 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:44.129012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:44.129469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:44.129893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:44.194029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:44.201772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e6e2a432-d3d8-400c-8180-39153438aef0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086101 Sep 07 08:15:44.202341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 769/1514] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:45.226765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:45.227410 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:45.234561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:45.235042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:45.235477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:45.236195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:45.236652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:45.237078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:45.297688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:45.305308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9676033d-4ef8-4da7-a165-cf0754a4b227 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084644 Sep 07 08:15:45.305864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 746/1515] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:46.329092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:46.329700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:46.336062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:46.336569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:46.336999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:46.337678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:46.338126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:46.338543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:46.401283 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:46.408838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5403a9d6-a8c3-446b-b876-77b6c7b00abe tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083595 Sep 07 08:15:46.409411 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 770/1516] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:47.431441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:47.432046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:47.439301 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:47.439788 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:47.440270 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:47.440963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:47.441419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:47.441842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:47.502117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:47.509641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-86595d8a-ef0d-4690-b819-e0f49f76a495 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082042 Sep 07 08:15:47.510902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 747/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:48.533241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:48.533857 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:48.540360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:48.541051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:48.541270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:48.542018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:48.542471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:48.542894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:48.603507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:48.611322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2e620a21-9748-45e5-a481-c43397204dd0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081917 Sep 07 08:15:48.611891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 771/1518] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:49.634602 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:49.635165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:49.641730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:49.642218 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:49.642658 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:49.643355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:49.643810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:49.644292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:49.711533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:49.720281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0ea9126f-a769-46a1-9faa-200d7a626762 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089683 Sep 07 08:15:49.720866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 748/1519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:50.744060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:50.744624 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:50.751682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:50.752193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:50.752625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:50.753309 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:50.753760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:50.754178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:50.817798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:50.825537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a617a0cd-86cb-46ca-a457-68e0465e1832 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085419 Sep 07 08:15:50.826093 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 772/1520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:51.847692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:51.848341 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:51.854860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:51.855338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:51.855771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:51.856488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:51.856942 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:51.857393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:51.920194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:51.927883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3dd01cce-f3cf-456c-a491-31605e097d11 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083974 Sep 07 08:15:51.928477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 749/1521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:52.950884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:52.951497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:52.957479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:52.957957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:52.958388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:52.959096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:52.959545 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:52.959961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:53.026978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:53.034824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5917fdd3-a861-48d6-b6b7-5a80c7a4ebbd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088440 Sep 07 08:15:53.035389 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 773/1522] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:54.057876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:54.058472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:54.064751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:54.065233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:54.065667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:54.066350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:54.066801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:54.067225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:54.127941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:54.135892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b4c22975-6ee8-4ecc-ad72-d63f3230069d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081740 Sep 07 08:15:54.136496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 750/1523] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:55.160307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:55.160918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:55.168369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:55.168852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:55.169284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:55.170023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:55.170476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:55.170896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:55.232629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:55.240263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-515e0211-8489-43bf-863d-4cccd5a2807c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083843 Sep 07 08:15:55.240827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 774/1524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:56.264127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:56.264742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:56.271271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:56.271758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:56.272360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:56.273064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:56.273527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:56.273960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:56.335881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:56.344220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-537bdd4b-79bb-4fd2-a1d1-75c74fdf2952 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084861 Sep 07 08:15:56.344790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 751/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:57.367117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:57.367794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:57.374444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:57.374922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:57.375349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:57.376029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:57.376505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:57.376928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:57.438532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:57.446329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6309c008-bd9e-4760-822b-022d1040130b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083050 Sep 07 08:15:57.446893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 775/1526] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:58.469493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:58.470137 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:58.476553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:58.477037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:58.477471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:58.478163 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:58.478622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:58.479049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:58.542290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:58.550246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8ee6b50-ec89-4cc9-aaf1-a0961e7ff1be tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084657 Sep 07 08:15:58.550814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 752/1527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:15:59.574292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:15:59.574944 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:15:59.581409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:59.581897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:59.582333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:59.583028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:15:59.583487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:15:59.583911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:15:59.647065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:15:59.655937 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-52eba9c4-bcf9-450c-bdfd-77cf972daf42 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086171 Sep 07 08:15:59.656529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 776/1528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:15:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:00.678288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:00.678829 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:00.685461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:00.686197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:00.686632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:00.687317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:00.687773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:00.688241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:00.748021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:00.755817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-90144250-df7a-4a34-be63-e38b1d0e5ce7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081405 Sep 07 08:16:00.756409 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 753/1529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:01.778689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:01.779306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:01.785790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:01.786278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:01.786711 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:01.787405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:01.787861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:01.788319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:01.854210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:01.862643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf3da4da-fb2e-4dc6-b2aa-a63797338940 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087902 Sep 07 08:16:01.863212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 777/1530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:02.885421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:02.886740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:02.893468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:02.893948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:02.894376 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:02.895068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:02.895571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:02.895977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:02.959497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:02.967390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-da25b355-6f05-4b73-8161-7c2853c0982f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085852 Sep 07 08:16:02.967946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 754/1531] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:03.990319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:03.990942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:03.997716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:03.998205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:03.998647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:03.999341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:03.999800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:04.000273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:04.217628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:04.225343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f7ec500f-a59b-4cd4-a0a3-966612d24d6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.238974 Sep 07 08:16:04.225904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 778/1532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:05.248785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:05.249378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:05.251642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:05.257334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:05.257846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:05.258280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:05.258962 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:05.259412 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:05.259830 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:05.263848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:05.321662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:05.329342 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f2cb6f80-5d5d-4070-a8fc-8723fd198ae0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084458 Sep 07 08:16:05.329902 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 755/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:06.353249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:06.353803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:06.356803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:06.362316 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:06.362807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:06.363258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:06.363959 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:06.364458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:06.364874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:06.368749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:06.426752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:06.434485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cea434c8-912a-41c2-99d5-7226c87d520d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085396 Sep 07 08:16:06.435032 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 779/1534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:07.457625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:07.458215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:07.465070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:07.465548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:07.465976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:07.466652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:07.467097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:07.467514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:07.532314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:07.539888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-369165d0-cd7e-4532-99d1-ebacb401af45 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086090 Sep 07 08:16:07.540471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 756/1535] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:08.563978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:08.564614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:08.570984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:08.571460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:08.571892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:08.572596 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:08.573088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:08.573537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:08.638703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:08.646420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4160b11e-b6fe-49d8-aef8-d39a4931ed95 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086888 Sep 07 08:16:08.646978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 780/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:09.669382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:09.669978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:09.676589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:09.677076 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:09.677531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:09.678202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:09.678656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:09.679080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:09.741153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:09.749384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6cdddf9b-a368-4474-92c5-3eac837860c8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084042 Sep 07 08:16:09.749944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 757/1537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:10.772570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:10.773187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:10.780232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:10.780720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:10.781154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:10.781840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:10.782293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:10.782717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:10.849796 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:10.857806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ad9b1282-1f64-49f5-a3ad-9c6e96044866 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089111 Sep 07 08:16:10.858368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 781/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:11.880319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:11.880929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:11.887980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:11.888495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:11.888929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:11.889615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:11.890065 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:11.890488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:11.951436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:11.959182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-818d5593-1bc1-4f6f-8bcb-13027fd4e1f5 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082815 Sep 07 08:16:11.959744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 758/1539] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:12.981991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:12.982598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:12.988948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:12.989716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:12.990155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:12.990906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:12.991365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:12.991786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:13.053605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:13.061839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-303112f3-9ddb-4003-8db3-a9118f2b98f1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083851 Sep 07 08:16:13.062399 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 782/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:14.084616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:14.085164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:14.092968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:14.093464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:14.093907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:14.094610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:14.095067 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:14.095507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:14.158500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:14.166058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-139c514c-2968-46ed-af81-034ae66a9a01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085374 Sep 07 08:16:14.166616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 759/1541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:14 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:15.190166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:15.190763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:15.197363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:15.197850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:15.198288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:15.198983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:15.199463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:15.199990 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:15.271849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:15.279779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b410c6de-8176-4874-8520-26e5dff6aaf6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.093504 Sep 07 08:16:15.280377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 783/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:16.302659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:16.303261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:16.310342 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:16.311088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:16.311525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:16.312235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:16.312693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:16.313124 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:16.381836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:16.390543 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b32053d-85fe-4071-8dec-f928b0546c12 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.091676 Sep 07 08:16:16.391107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 760/1543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:17.413367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:17.413996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:17.421259 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:17.421753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:17.422190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:17.422891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:17.423354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:17.423784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:17.484507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:17.492167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47a7b942-e6c7-4b9e-85c6-06018b15e2fa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082673 Sep 07 08:16:17.492728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 784/1544] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:18.514589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:18.515195 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:18.521679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:18.522155 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:18.522587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:18.523268 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:18.523716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:18.524165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:18.584598 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:18.592831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-98f54869-cf61-423c-a9b5-353d08b3f12b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082157 Sep 07 08:16:18.593384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 761/1545] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:19.616196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:19.616803 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:19.623606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:19.624103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:19.624541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:19.625225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:19.625678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:19.626099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:19.690175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:19.697860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-229fac07-ca85-4e7d-be14-09a7564025fd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085733 Sep 07 08:16:19.698422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 785/1546] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:20.721034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:20.721617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:20.728007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:20.728517 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:20.728949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:20.729627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:20.730075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:20.730569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:20.792849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:20.800705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b1abcbe2-284a-4a43-8f2f-a1ac18e9294e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083568 Sep 07 08:16:20.801272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 762/1547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:21.823753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:21.824397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:21.831016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:21.831500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:21.831932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:21.833020 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:21.833476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:21.833898 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:21.894890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:21.902562 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fb47d3c7-8989-4305-9d52-d861b6328467 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082766 Sep 07 08:16:21.903115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 786/1548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:22.924961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:22.925595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:22.931934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:22.932449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:22.932886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:22.933571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:22.934026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:22.934450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:22.995911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:23.003837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2522ed13-d718-4adb-b8a4-458a97cc3ad6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082725 Sep 07 08:16:23.004439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 763/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:16:24.026207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:24.026908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:24.034007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:24.034491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:24.034925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:24.035611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:24.036061 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:24.036505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:24.098602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:24.106315 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1ca20b58-8b35-49cd-b328-b8657236421d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083959 Sep 07 08:16:24.106927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 787/1550] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:25.129979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:25.130631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:25.136743 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:25.137232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:25.137689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:25.138402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:25.139145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:25.139585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:25.209406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:25.217245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9f184e4f-6ad7-4b77-aae3-0d962fd490e2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.091300 Sep 07 08:16:25.217806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 764/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:26.240660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:26.241273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:26.248331 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:26.248838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:26.249272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:26.249955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:26.250408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:26.250830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:26.312459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:26.320131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6ce37d3d-370f-4ba6-8d9c-cb5aaddf53b2 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083372 Sep 07 08:16:26.320691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 788/1552] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:27.344528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:27.345141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:27.351456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:27.351933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:27.352390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:27.353071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:27.353519 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:27.353936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:27.414651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:27.423287 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f67b7b73-2577-497a-bbe3-278d7f39f37b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083488 Sep 07 08:16:27.423846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 765/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:28.446820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:28.447438 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:28.455137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:28.456045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:28.456773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:28.457497 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:28.457966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:28.458403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:28.525882 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:28.534037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5c4f3a36-ad84-4222-83b5-66284aa27028 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.091198 Sep 07 08:16:28.534605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 789/1554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:16:29.558010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:29.558640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:29.565846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:29.566327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:29.566755 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:29.567462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:29.567912 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:29.568354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:29.627901 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:29.635531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85337643-fc8e-4440-bed4-eb681d9aa13e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081326 Sep 07 08:16:29.636025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 766/1555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:30.658398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:30.658949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:30.665383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:30.665865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:30.666304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:30.666994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:30.667449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:30.667874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:30.731459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:30.739221 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-504f4dca-90ec-426e-8dd4-ed72ef22fa92 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084807 Sep 07 08:16:30.739786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 790/1556] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:31.761882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:31.762436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:31.769242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:31.769720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:31.770154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:31.770835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:31.771283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:31.771705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:31.831651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:31.839204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c425ed2f-6503-464c-9a5d-1d0185ea1c2f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081331 Sep 07 08:16:31.839758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 767/1557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:32.863448 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:32.863987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:32.870386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:32.870871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:32.871312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:32.872007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:32.872491 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:32.872921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:32.937074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:32.945611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-42f86d91-ac80-4a5a-bfa7-b5390d41f6ba tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086098 Sep 07 08:16:32.946213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 791/1558] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:32 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:33.968765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:33.969368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:33.975692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:33.976208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:33.976642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:33.977322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:33.977772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:33.978191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:34.040904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:34.049190 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-78a372df-30fe-4353-9a8f-f7cce4cdca54 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084281 Sep 07 08:16:34.049746 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 768/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:33 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:35.072952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:35.073522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:35.080527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:35.081021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:35.081464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:35.082163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:35.082630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:35.083058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:35.145736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:35.153486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8d133552-bd7b-4b7a-b567-b3d960132494 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084543 Sep 07 08:16:35.154054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 792/1560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:36.175562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:36.176186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:36.178551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:36.183441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:36.183919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:36.184382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:36.185066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:36.185826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:36.186244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:36.189157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:36.247952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:36.255681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-879bd98d-f2af-499b-8516-674b027c6d90 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084007 Sep 07 08:16:36.256261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 769/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:37.279017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:37.280293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:37.282792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:37.287963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:37.288475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:37.288908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:37.289590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:37.290046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:37.290466 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:37.293165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:16:37.355229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:37.363527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c96bce5d-17cb-44b6-946f-4f27970a9673 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.088389 Sep 07 08:16:37.364109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 793/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:38.386361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:38.386968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:38.394076 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:38.394560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:38.394993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:38.395681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:38.396168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:38.396599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:38.458178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:38.465792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-78143eec-f6e1-43af-b28f-0e2c924fee56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083328 Sep 07 08:16:38.466345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 770/1563] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:39.488744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:39.489312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:39.495743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:39.496264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:39.496705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:39.497398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:39.498349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:39.498778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:39.558691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:39.567199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e7c20d97-bf51-4bdb-a847-b8eef49371ee tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082412 Sep 07 08:16:39.567795 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 794/1564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:40.590327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:40.590939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:40.597871 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:40.598355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:40.598792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:40.599486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:40.599940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:40.600392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:40.668029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:40.676202 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ab59e225-a9e6-42ed-8c72-ee167d6ba54a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.089677 Sep 07 08:16:40.676779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 771/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:41.698956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:41.699501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:41.707245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:41.707736 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:41.708207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:41.708903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:41.709360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:41.709786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:41.770607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:41.778353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4ac3fde-cdd6-4df2-98b1-cbfc7c54788f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083401 Sep 07 08:16:41.778922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 795/1566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:42.800995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:42.801608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:42.807932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:42.808452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:42.808890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:42.809577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:42.810040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:42.811061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:43.072883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:16:43.073170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:16:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:16:43.074201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:16:43.074332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:16:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:16:43.114786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:43.122595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-89d137c4-c57e-4d6a-a36c-f164ff6b70e8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.325404 Sep 07 08:16:43.124054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 772/1567] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:44.145847 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:44.146479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:44.153629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:44.154384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:44.154928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:44.155616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:44.156072 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:44.156514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:44.219598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:44.227316 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df592860-4b6d-4c24-aa9d-2494c5718403 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085368 Sep 07 08:16:44.227872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 796/1568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:44 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:45.250328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:45.250929 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:45.257271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:45.257751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:45.258186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:45.258867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:45.259320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:45.259740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:45.320166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:45.328304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d380c729-e182-4b3c-80f1-67875d2c7399 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081784 Sep 07 08:16:45.328861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 773/1569] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:46.350953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:46.351569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:46.358840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:46.359321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:46.359753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:46.360461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:46.360911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:46.361332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:46.424644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:46.432358 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3bd55601-261e-4ce7-99bc-20809386385d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085272 Sep 07 08:16:46.432909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 797/1570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:47.454499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:47.455117 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:47.461686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:47.462179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:47.462618 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:47.463311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:47.463771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:47.464232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:47.525728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:47.533833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d95f3c2a-b96f-4b4e-b229-787c74622852 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083601 Sep 07 08:16:47.534396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 774/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:48.557143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:48.557749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:48.564522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:48.565001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:48.565434 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:48.566134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:48.566572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:48.566994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:48.634099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:48.643942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6e826572-1435-4577-9088-d720fce17db0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.090669 Sep 07 08:16:48.644540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 798/1572] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:16:49.666859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:49.667468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:49.674672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:49.675149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:49.675585 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:49.676294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:49.676750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:49.677175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:49.737553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:49.745142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-513c3169-8f69-4c46-8eba-4db82594eea9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082200 Sep 07 08:16:49.745703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 775/1573] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:50.768779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:50.769292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:50.775683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:50.776195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:50.776632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:50.777321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:50.777776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:50.778198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:50.840138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:50.848625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f2f58174-40f4-4989-8954-6215e3b79c37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083935 Sep 07 08:16:50.849191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 799/1574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:51.871608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:51.872175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:51.878591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:51.879074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:51.879514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:51.880228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:51.880687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:51.881119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:51.944953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:51.953160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-24fd2890-3c60-4e98-9d14-0022cbba2f91 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085360 Sep 07 08:16:51.953744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 776/1575] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:52.976163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:52.976739 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:52.982659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:52.983143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:52.983579 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:52.984938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:52.985398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:52.985826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:53.046650 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:53.054975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6443ce85-a8d6-48d2-ad3b-053611762eb4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083030 Sep 07 08:16:53.055547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 800/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:54.078562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:54.079194 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:54.085235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:54.085710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:54.086138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:54.086813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:54.087262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:54.087679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:54.149006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:54.157262 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-356e3d5c-92f1-4ae2-afcd-524398da2884 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083079 Sep 07 08:16:54.157820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 777/1577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:54 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:55.179999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:55.180662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:55.187988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:55.188531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:55.188962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:55.189655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:55.190111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:55.190533 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:55.255862 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:55.263824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fdcafcdc-3f38-46fa-be30-a172ddd95ac8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087734 Sep 07 08:16:55.264422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 801/1578] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:56.288232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:56.288833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:56.295160 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:56.295641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:56.296073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:56.297432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:56.297911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:56.298335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:56.360536 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:56.368033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6f894212-e143-4c00-8f1b-47c056f14733 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083689 Sep 07 08:16:56.368611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 778/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:57.391028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:57.391648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:57.398050 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:57.398535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:57.398980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:57.399672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:57.400157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:57.400587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:57.462262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:57.470645 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5698205-0ac0-4b73-b398-8841fa964bbb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084058 Sep 07 08:16:57.471207 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 802/1580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:58.493457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:58.494066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:58.500527 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:58.501011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:58.501446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:58.502128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:58.502583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:58.503006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:58.563388 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:58.572114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e58088d1-38cf-4a29-935d-2f9a6423d771 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082437 Sep 07 08:16:58.572684 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 779/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:16:59.594704 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:16:59.595319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:16:59.601889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:59.602373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:59.602811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:59.603501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:16:59.603962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:16:59.604416 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:16:59.667655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:16:59.675867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a64e98f8-0b5c-41d9-afb4-ab7ef670c9df tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085309 Sep 07 08:16:59.676457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 803/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:16:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:00.699260 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:00.699810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:00.706623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:00.707114 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:00.707554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:00.708278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:00.708739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:00.709166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:00.771682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:00.779324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6ddd74e2-bc05-4953-95d9-5d65ea75f825 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084009 Sep 07 08:17:00.779885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 780/1583] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:01.802978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:01.803546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:01.809921 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:01.810643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:01.811081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:01.811772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:01.812264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:01.812699 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:01.875656 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:01.883484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-29b68bc8-5167-4be5-b58c-63c20f87c0b4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084503 Sep 07 08:17:01.884043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 804/1584] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:02.906925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:02.907530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:02.913946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:02.914423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:02.914854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:02.915561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:02.916012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:02.916460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:02.978419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:02.987123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7a81fd77-37c9-4c1a-8781-ceb0f8801cd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084649 Sep 07 08:17:02.987688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 781/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:04.009104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:04.009695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:04.016300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:04.016784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:04.017218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:04.017904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:04.018355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:04.018778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:04.082092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:04.089671 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c35672a-6e55-4950-ac2c-3bb7c1c93a9c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084410 Sep 07 08:17:04.090230 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 805/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:05.112635 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:05.113227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:05.119559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:05.120037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:05.120496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:05.121176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:05.121624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:05.122048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:05.184156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:05.192721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2938407e-38ba-4d73-96da-899d0dea5d29 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084570 Sep 07 08:17:05.193292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 782/1587] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:05 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:06.217649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:06.218278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:06.224678 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:06.225159 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:06.225593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:06.226278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:06.226759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:06.227182 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:06.287654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:06.301313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-54236677-cca8-4af8-9007-23f4d0114bea tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087409 Sep 07 08:17:06.301912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 806/1588] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:07.325115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:07.325708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:07.328845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:07.334552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:07.335037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:07.335466 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:07.336205 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:07.336655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:07.337101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:07.339638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:07.398731 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:07.406550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-70988006-4c44-44a4-b1fd-7a7015d0f296 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085291 Sep 07 08:17:07.407156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 783/1589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:08.429028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:08.429638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:08.431920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:08.438930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:08.439763 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:08.440296 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:08.441121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:08.441622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:08.442105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:08.444934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:08.503958 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:08.511605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3264c47e-1cf8-49d4-8473-e43761d5b6a1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086453 Sep 07 08:17:08.512175 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 807/1590] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:09.536831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:09.537448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:09.544022 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:09.544565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:09.545005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:09.545702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:09.546241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:09.546937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:09.610689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:09.618372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-149d0837-e657-41dc-954a-d3cfbc88984a tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085422 Sep 07 08:17:09.618932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 784/1591] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:10.642973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:10.643519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:10.650036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:10.650512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:10.650945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:10.651629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:10.652095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:10.652524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:10.715644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:10.723545 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-043ab603-4b78-443f-8b82-14a775a0941c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084811 Sep 07 08:17:10.724129 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 808/1592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:11.746707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:11.747250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:11.753695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:11.754177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:11.754608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:11.755298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:11.755746 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:11.756209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:11.818408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:11.826109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aa04e854-cb03-4c9e-9491-f9405dd2d9c3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083359 Sep 07 08:17:11.826675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 785/1593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:12.849008 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:12.849563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:12.855996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:12.856511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:12.856949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:12.857639 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:12.858097 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:12.858523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:12.925139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:12.932903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0c98db11-d194-4b06-9943-546a29a3239c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087922 Sep 07 08:17:12.933472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 809/1594] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:13.956866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:13.957403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:13.963727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:13.964234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:13.964664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:13.965345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:13.965797 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:13.966214 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:14.028692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:14.036402 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a8b53752-13a1-450d-b409-632421424082 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084089 Sep 07 08:17:14.036960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 786/1595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:15.059033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:15.059623 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:15.066276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:15.066751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:15.067177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:15.067855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:15.068335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:15.068756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:15.353137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:15.360963 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35a7e939-fe9f-47a1-b2e6-5ac687a6feb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.305808 Sep 07 08:17:15.361525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 810/1596] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:16.365211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:16.365739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:16.373328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:16.373816 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:16.374252 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:16.375000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:16.375593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:16.376025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:16.382931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:16.383915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:16.390178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:16.390700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:16.391144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:16.391838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:16.392321 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:16.392750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:16.403164 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 08:17:16.458706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:16.466535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d6ec6c1f-6a34-49fe-9cf0-a706a6d6473e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087449 Sep 07 08:17:16.467074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 811/1597] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:16.485774 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-93f541f6-97bb-41b2-9b85-f3581156788b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 204 len: 0 microversion: 2.1 time: 0.124206 Sep 07 08:17:16.486386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 787/1598] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 7 08:17:16 2022] DELETE /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 08:17:16.496933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:16.497581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:16.504172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:16.504662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:16.505103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:16.505802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:16.506260 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:16.506690 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:16.636416 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:16.645146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df5d4a1e-a799-44e8-8c0c-b84963a11ea7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154484 Sep 07 08:17:16.645715 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 812/1599] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:16 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:17.494233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:17.494899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:17.502059 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:17.502541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:17.502973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:17.503660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:17.504141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:17.504571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:17.566976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:17.574676 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e7fef378-6fd9-42b9-a6e3-06dbaf28e476 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084749 Sep 07 08:17:17.575243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 788/1600] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:17.668669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:17.669217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:17.676265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:17.676746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:17.677184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:17.677876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:17.678330 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:17.678755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:17.808064 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:17.816630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-104c3c0e-5546-485a-9835-4da328858a96 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151873 Sep 07 08:17:17.817194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 813/1601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:17 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:18.597217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:18.597827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:18.604387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:18.604868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:18.605297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:18.606323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:18.606772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:18.607191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:18.670738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:18.678377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c042d66d-c9ad-4075-97c9-2ae222458102 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085227 Sep 07 08:17:18.678932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 789/1602] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:18.839161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:18.839772 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:18.846435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:18.846913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:18.847343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:18.848025 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:18.848536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:18.848955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:18.974299 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:18.982391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d378fa97-8a30-4431-9596-d9b1e602eed3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.147046 Sep 07 08:17:18.982962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 814/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:18 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:19.701884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:19.702509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:19.709531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:19.710013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:19.710449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:19.711127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:19.711577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:19.711997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:19.772660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:19.780227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1c980188-30ae-44e0-88a1-dab159869cf3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082389 Sep 07 08:17:19.780835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 790/1604] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:20.006854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:20.007415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:20.013837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:20.014317 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:20.014749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:20.016280 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:20.016741 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:20.017167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:20.145766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:20.153826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-892ce866-1401-42cd-996f-7a1c6a0ff198 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151041 Sep 07 08:17:20.154388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 815/1605] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:20 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:20.803387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:20.803923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:20.810467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:20.810948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:20.811377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:20.812053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:20.812531 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:20.812948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:20.875103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:20.882772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-76589096-3854-48e3-b891-973effdf908c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083366 Sep 07 08:17:20.883325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 791/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:21.176314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:21.176984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:21.183022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:21.183506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:21.183945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:21.184662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:21.185401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:21.185828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:21.312969 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:21.321052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5a370cc5-872a-4fe7-a79d-6cc35fc6ec63 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149028 Sep 07 08:17:21.321613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 816/1607] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:21 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:21.905582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:21.906979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:21.913327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:21.913804 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:21.914232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:21.914909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:21.915358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:21.915777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:21.978544 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:21.986477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-41fd162d-8c04-478e-bbb3-18e36707b91b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085069 Sep 07 08:17:21.987034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 792/1608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:22.344663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:22.345232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:22.351607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:22.352107 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:22.352554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:22.353242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:22.353696 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:22.354122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:22.484268 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:22.492453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0fb7c26-5b8e-4ff4-90ec-7fa75b16d3cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151824 Sep 07 08:17:22.493023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 817/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:22 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:23.008507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:23.009112 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:23.015386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:23.016025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:23.016497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:23.017174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:23.017653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:23.018074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:23.082646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:23.090261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6552ba49-fcc2-47a3-bf2b-c428afa92345 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085599 Sep 07 08:17:23.090823 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 793/1610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:23.516485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:23.517094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:23.523960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:23.524500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:23.525000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:23.525720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:23.526332 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:23.526768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:23.652892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:23.661698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aadf7917-aa67-4c22-a767-6c6ea4d1bd26 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149731 Sep 07 08:17:23.662264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 818/1611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:23 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:24.115290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:24.115836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:24.121895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:24.122372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:24.122801 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:24.123480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:24.123924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:24.124367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:24.183678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:24.192294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d6b50906-c931-4de1-bbd2-35bf9cc9bdb9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.080878 Sep 07 08:17:24.192859 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 794/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:24 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:24.684493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:24.685284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:24.692157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:24.692646 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:24.693084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:24.693779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:24.694237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:24.694667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:24.820805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:24.829552 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-779d362e-e3d1-4514-9431-3374551ba9c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149117 Sep 07 08:17:24.830114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 819/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:24 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:25.214578 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:25.215290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:25.221873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:25.222367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:25.222808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:25.223502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:25.224038 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:25.224496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:25.285304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:25.293039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e01df616-a72f-4903-a670-4eeb24669770 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082323 Sep 07 08:17:25.293615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 795/1614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:25.853241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:25.853878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:25.861965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:25.862451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:25.862885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:25.863569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:25.864021 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:25.864469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:25.998947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:26.007131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0de764aa-e686-4694-b133-369c16a7af9b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157737 Sep 07 08:17:26.007693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 820/1615] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:25 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:26.315813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:26.316472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:26.322857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:26.323337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:26.323772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:26.324493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:26.324948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:26.325373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:26.386153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:26.394375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2ecc544d-621e-4fb6-8ba5-e7f78cecfb70 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082547 Sep 07 08:17:26.394934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 796/1616] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:26 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:27.030094 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:27.030792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:27.037282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:27.037764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:27.038217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:27.038891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:27.039349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:27.039776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:27.166537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:27.175288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9af26182-82a6-47dc-a9f6-cc8d047706cf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149355 Sep 07 08:17:27.175855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 821/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:27 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:27.417600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:27.418216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:27.425399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:27.425885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:27.426324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:27.427017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:27.427474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:27.427899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:27.491931 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:27.499705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0ef4fb9d-16b3-4ea5-81fb-e6d0d324bfa7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085893 Sep 07 08:17:27.500386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 797/1618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:27 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:28.199110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:28.199712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:28.206775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:28.207255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:28.207702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:28.208394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:28.208844 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:28.209264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:28.341353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:28.350083 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-dd2a37e5-dc1c-4ba7-86fe-25d050bd9783 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154906 Sep 07 08:17:28.350655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 822/1619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:28 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:28.522241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:28.522779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:28.529225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:28.529707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:28.530150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:28.530960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:28.531501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:28.531930 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:28.534583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:28.595247 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:28.603066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-44e44580-050a-4880-bc5d-9824f502c05f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084782 Sep 07 08:17:28.603629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 798/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:28 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:29.375413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:29.376022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:29.382489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:29.382972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:29.383409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:29.384122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:29.384572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:29.384994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:29.522872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:29.525096 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:29.533629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d8b641d9-72fb-4814-970f-f75aae9cabfc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.162180 Sep 07 08:17:29.534210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 823/1621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:29 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:29.626469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:29.627066 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:29.634335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:29.634825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:29.635261 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:29.635965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:29.636464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:29.636895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:29.707174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:29.716356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-90f95976-d900-4dcd-a923-dd942f21ce25 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.093694 Sep 07 08:17:29.717319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 799/1622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:29 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:30.555776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:30.556443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:30.563271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:30.563749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:30.564206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:30.564891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:30.565341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:30.565768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:30.694570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:30.702741 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-478f855c-da42-49ae-a4ff-94188ae76052 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150874 Sep 07 08:17:30.703300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 824/1623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:30 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:30.739375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:30.739984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:30.746311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:30.746786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:30.747216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:30.747893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:30.748372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:30.748791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:30.808822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:30.816673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-04af55d8-0d78-4a07-a92d-31b0e7a447bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081102 Sep 07 08:17:30.817224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 800/1624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:30 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:31.726379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:31.726993 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:31.734167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:31.734742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:31.735178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:31.735868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:31.736350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:31.736773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:31.839449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:31.840062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:31.846776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:31.847268 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:31.847709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:31.848649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:31.849110 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:31.849539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:31.869694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:31.878539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2a25e553-c689-41a5-8d9f-6ea246080919 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156228 Sep 07 08:17:31.879104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 825/1625] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:31 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:31.919225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:31.927707 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5568e567-9464-4da4-bf89-e18e6b908eed tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.092170 Sep 07 08:17:31.928298 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 801/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:31 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:32.901872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:32.902488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:32.910136 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:32.910621 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:32.911060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:32.911751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:32.912248 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:32.912680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:32.950495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:32.951336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:32.958700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:32.959271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:32.959788 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:32.960588 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:32.961119 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:32.961612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:33.029776 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:33.037756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5fa9c262-5c72-40b1-a7e1-10685c7c01d1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.091033 Sep 07 08:17:33.038347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 802/1627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:32 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:33.044846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:33.053592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4882793-ad1c-4261-a4fe-2b25858e6380 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155650 Sep 07 08:17:33.054144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 826/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:32 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:34.061105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:34.062502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:34.068979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:34.069457 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:34.069885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:34.070584 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:34.071023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:34.071430 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:34.077199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:34.078016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:34.084511 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:34.085002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:34.085445 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:34.086148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:34.086614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:34.087052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:34.132836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:34.141072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-68b97a03-530c-4118-9c05-6d37b10a6320 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083933 Sep 07 08:17:34.141649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 803/1629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:34 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:34.220345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:34.228443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afbc9a04-7315-4ceb-bfbe-1e4ff775066b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155086 Sep 07 08:17:34.229008 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 827/1630] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:34 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:35.164350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:35.164957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:35.171390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:35.171872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:35.172334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:35.173013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:35.173470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:35.173891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:35.234302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:35.242017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-81297929-605a-4698-b84a-7eac6a2e0a7f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081628 Sep 07 08:17:35.242568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 804/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:35 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:35.252286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:35.253468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:35.259871 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:35.260387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:35.260821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:35.261510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:35.261962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:35.262382 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:35.390810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:35.398982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-88dbf240-e246-4bc5-984c-af95d6b46d5c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151141 Sep 07 08:17:35.399547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 828/1632] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:35 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:36.265546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:36.266199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:36.272480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:36.272960 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:36.273390 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:36.274073 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:36.274522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:36.274939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:36.337613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:36.345727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b0aff5d5-4d4e-4a2a-a219-c0d0254350aa tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084512 Sep 07 08:17:36.346289 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 805/1633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:36 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:36.422482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:36.423100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:36.429542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:36.430033 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:36.430475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:36.431171 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:36.431632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:36.432062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:36.564732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:36.572897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d77a19e-af32-439b-a5a8-eef6eaa6860a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154569 Sep 07 08:17:36.573470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 829/1634] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:36 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:37.368577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:37.369192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:37.371523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:37.376733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:37.377223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:37.377667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:37.378367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:37.378825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:37.379254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:37.443949 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:37.451620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-25893e3d-155a-40a2-a786-5914ef8c49dd tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086895 Sep 07 08:17:37.452197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 806/1635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:37 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:37.597547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:37.598154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:37.604609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:37.605098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:37.605538 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:37.606225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:37.606680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:37.607105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:37.737702 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:37.745859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a691bf8a-b8d6-4d6c-8df0-d903e7d910d8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153010 Sep 07 08:17:37.746462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 830/1636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:37 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:38.474729 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:38.475346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:38.481792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:38.482271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:38.482702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:38.483874 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:38.484352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:38.484777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:38.544589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:38.552631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fb5fdf24-7eb8-4b80-865c-a520797dad37 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081876 Sep 07 08:17:38.553190 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 807/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:38 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:38.768527 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:38.769104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:38.772530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=48 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:38.776599 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:38.777084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:38.777522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:38.778217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:38.778675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:38.779109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:38.906817 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:38.914984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-81cce08b-1066-48f6-8038-28cad7e7bf46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150579 Sep 07 08:17:38.915576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 831/1638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:38 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:39.576254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:39.576860 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:39.583812 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:39.584332 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:39.584767 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:39.585450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:39.585898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:39.586317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:39.646156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:39.653690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d019cb96-5d2e-4a9b-a1ca-ebc011a4a14b tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081332 Sep 07 08:17:39.654250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 808/1639] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:39 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:39.939471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:39.940039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:39.946404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:39.946878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:39.947307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:39.947991 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:39.948478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:39.948899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:40.079973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:40.088093 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bee71c76-ebe7-4d74-9360-68b7e0f64c9d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153566 Sep 07 08:17:40.088660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 832/1640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:39 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:40.676326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:40.676867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:40.683372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:40.683846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:40.684312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:40.685241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:40.685690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:40.686133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:40.749887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:40.757582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0fa8aeb3-ac71-499d-b936-58cc2285f63c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085257 Sep 07 08:17:40.758139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 809/1641] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:40 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:41.111339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:41.111895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:41.118368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:41.118853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:41.119290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:41.119980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:41.120467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:41.120897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:41.253292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:41.261414 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d7292099-ce82-4dc5-85a0-c4af90ee0d37 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154128 Sep 07 08:17:41.261975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 833/1642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:41 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:41.781561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:41.782115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:41.788472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:41.788950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:41.789379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:41.790056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:41.790502 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:41.790921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:41.854042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:41.862492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3040563d-f824-4f97-b5dd-74b1305bf6f8 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086242 Sep 07 08:17:41.863056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 810/1643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:41 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:42.286058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:42.286676 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:42.293229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:42.293714 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:42.294150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:42.294843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:42.295300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:42.296326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:42.428691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:42.437240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab97a4d8-cabf-46e1-a378-5ad06f158fb7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155128 Sep 07 08:17:42.437806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 834/1644] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:42 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:42.884541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:42.885154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:42.892397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:42.892885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:42.893323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:42.894021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:42.894474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:42.894897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:42.958405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:42.966948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5969b915-5b83-480e-8bb6-62fb2897f3fb tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086264 Sep 07 08:17:42.968157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 811/1645] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:42 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:43.460266 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:43.460887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:43.467326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:43.467876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:43.468480 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:43.469181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:43.469639 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:43.470063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:43.602372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:43.611065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-badde5d0-1989-4538-861f-726c4c66efff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154693 Sep 07 08:17:43.611641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 835/1646] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:43 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:43.991395 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:43.992028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:43.998404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:43.998985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:43.999506 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:44.000250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:44.000706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:44.001127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:44.063787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:44.071367 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4a7d305f-4c8c-4eef-b44b-068298274812 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084054 Sep 07 08:17:44.071925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 812/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:43 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:44.634609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:44.635161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:44.642043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:44.642523 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:44.642955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:44.643635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:44.644100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:44.644525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:44.776845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:44.785180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0871d0d4-1af3-4c5a-94ea-c08717cceb11 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154478 Sep 07 08:17:44.785761 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 836/1648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:44 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:45.093884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:45.094433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:45.100822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:45.101307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:45.101742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:45.102428 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:45.102880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:45.103304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:45.168000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:45.176825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-63848e6e-2d99-4073-a012-12d0c45c4961 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086919 Sep 07 08:17:45.177386 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 813/1649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:45 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:45.808348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:45.808889 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:45.815851 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:45.816366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:45.816806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:45.817495 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:45.817946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:45.818369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:45.951530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:45.960534 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8da88fc0-561c-4fc7-9add-ce4bf5a915d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156109 Sep 07 08:17:45.961117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 837/1650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:45 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:46.200490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:46.201085 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:46.208152 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:46.208634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:46.209070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:46.209753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:46.210204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:46.210625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:46.271048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:46.273221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:46.279937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-14ac7138-f519-4ad1-91b4-9cf3d34a0423 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083264 Sep 07 08:17:46.280524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 814/1651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:46 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:46.985758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:46.986370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:46.992814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:46.993292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:46.993726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:46.994413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:46.994865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:46.995286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:47.122933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:47.131642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3b9a9c78-894f-40ef-9bef-1c0ab870c05b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150389 Sep 07 08:17:47.132240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 838/1652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:46 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:47.302857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:47.303399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:47.309820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:47.310558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:47.311108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:47.311868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:47.312343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:47.312775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:47.372694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:47.380360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7af2ee08-c41c-4b6a-983c-602d53c07ed4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081416 Sep 07 08:17:47.380926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 815/1653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:47 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:48.155063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:48.155832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:48.162162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:48.162640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:48.163070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:48.163752 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:48.164232 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:48.164653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:48.293831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:48.302804 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-caae4365-0e92-4799-9c6a-d26bcd92c67d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151898 Sep 07 08:17:48.303402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 839/1654] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:48 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:48.402583 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:48.403207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:48.410234 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:48.410655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:48.411091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:48.411765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:48.412265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:48.412689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:48.473235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:48.480837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d1c6e5ca-a538-48fd-9d52-c050aeee9aca tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082065 Sep 07 08:17:48.481385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 816/1655] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:48 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:49.327484 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:49.328229 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:49.334636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:49.335121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:49.335558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:49.336287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:49.336745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:49.337170 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:49.351682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:17:49.464764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:49.473106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3e120996-e83a-4e29-bc2b-f1cbb5362caa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150314 Sep 07 08:17:49.473668 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 840/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:49 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:49.504258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:49.504870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:49.511170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:49.511648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:49.512094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:49.512788 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:49.513244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:49.513671 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:49.577849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:49.585421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e6c87415-d3e2-4dac-b37f-8d31f04684e6 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085130 Sep 07 08:17:49.585970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 817/1657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:49 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:50.495957 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:50.496595 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:50.503097 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:50.503576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:50.504006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:50.504716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:50.505167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:50.505592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:50.608591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:50.608591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:50.614980 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:50.615467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:50.615905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:50.616632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:50.617093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:50.617518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:50.635737 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:50.644507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-917a76b4-142d-47eb-ab0f-880cc8752040 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152366 Sep 07 08:17:50.645080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 841/1658] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:50 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:50.681072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:50.689727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e7bd184d-2791-43f2-a9b0-a02636e1b269 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085651 Sep 07 08:17:50.690292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 818/1659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:50 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:51.667888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:51.668455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:51.675178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:51.675659 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:51.676104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:51.676821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:51.677269 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:51.677688 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:51.713105 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:51.713810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:51.720967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:51.721539 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:51.722068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:51.722836 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:51.723365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:51.723858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:51.786255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:51.794928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6b1a714e-40f3-4a6c-b226-d9684a843991 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085624 Sep 07 08:17:51.796206 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 819/1660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:51 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:51.809741 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:51.818276 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4aff830c-0cfd-4a86-a1a9-29dab8122d88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154375 Sep 07 08:17:51.818826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 842/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:51 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:52.818665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:52.819271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:52.825839 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:52.826324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:52.826794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:52.827483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:52.827934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:52.828392 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:52.841586 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:52.842462 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:52.848914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:52.849398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:52.849832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:52.850524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:52.850975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:52.851406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:52.889928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:52.897855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-adbc20f9-d929-4ac5-9d7e-c811ef4ffb49 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082976 Sep 07 08:17:52.898431 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 820/1662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:52 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:52.985134 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:52.993324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-44bff7f9-ab53-4d9c-b15c-ec8e5560bdc0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155567 Sep 07 08:17:52.993888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 843/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:52 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:17:53.921122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:53.921818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:53.927690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:53.928204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:53.928636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:53.929314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:53.929764 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:53.930183 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:53.993664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:54.001972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9c61bc2b-b109-46e2-abf9-f30c191945e1 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085008 Sep 07 08:17:54.002533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 821/1664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:53 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:54.017477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:54.018085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:54.024505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:54.024986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:54.025449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:54.026131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:54.026581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:54.027000 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:54.160281 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:54.168450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0b10a45a-6ed4-46f5-976e-4b5aca4fc2dc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155469 Sep 07 08:17:54.169023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 844/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:54 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:55.025053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:55.025663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:55.033035 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:55.033516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:55.033953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:55.034636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:55.035092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:55.035514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:55.096704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:55.104290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8dd1aedb-b346-419d-9a90-74f1e9bba04c tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083033 Sep 07 08:17:55.104845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 822/1666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:55 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:55.192792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:55.193387 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:55.199742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:55.200258 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:55.200694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:55.202034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:55.202492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:55.202914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:55.329111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:55.337308 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-15884128-61ee-4fd2-84f0-1fec5b79ca6f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148478 Sep 07 08:17:55.337868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 845/1667] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:55 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:56.127000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:56.127679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:56.134055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:56.134540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:56.134977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:56.135669 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:56.136140 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:56.136566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:56.213360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:56.221634 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fc96095b-f550-4a68-8625-8a2c5d099b01 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.098820 Sep 07 08:17:56.222197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 823/1668] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:56 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:56.360383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:56.360998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:56.367394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:56.367880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:56.368353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:56.369049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:56.369507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:56.369938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:56.518892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:56.527058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ff7992bd-129f-4373-8cfe-525b2c26844d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.170610 Sep 07 08:17:56.527631 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 846/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:56 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:57.245553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:57.246156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:57.253286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:57.253777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:57.254215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:57.254903 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:57.255356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:57.255780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:57.316099 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:57.323694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d2fb9838-a024-483b-9107-25e626ef0193 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082029 Sep 07 08:17:57.324281 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 824/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:57 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:57.551810 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:57.552402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:57.558865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:57.559354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:57.559791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:57.560767 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:57.561375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:57.561806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:57.689819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:57.697989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d904def-2751-4948-bb45-b57528fac571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150094 Sep 07 08:17:57.698551 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 847/1671] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:57 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:58.346427 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:58.347039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:58.353477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:58.353958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:58.354393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:58.355079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:58.355532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:58.355957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:58.420810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:58.428508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c492e312-15dc-4e17-a15b-113639453c87 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085931 Sep 07 08:17:58.429077 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 825/1672] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:58 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:58.721284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:58.721902 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:58.728376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:58.728865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:58.729314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:58.730009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:58.730468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:58.730897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:58.863085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:58.871224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e0747a01-d960-4fb8-9963-7defd118811a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154104 Sep 07 08:17:58.871780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 848/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:58 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:59.452509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:59.453113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:59.459513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:59.459988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:59.460464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:59.461144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:59.461593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:59.462011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:59.521784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:17:59.529322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-76176727-2e00-4e56-8aa1-9801f0fcf4d7 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081298 Sep 07 08:17:59.530501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 826/1674] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:59 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:17:59.894935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:17:59.895556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:17:59.902152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:59.902642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:59.903084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:17:59.903778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:17:59.904278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:17:59.904900 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:00.035383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:00.043689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4c74d82c-2e37-42ad-8207-c6c5de8cd49f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152654 Sep 07 08:18:00.044274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 849/1675] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:17:59 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:00.552275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:00.552888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:00.559253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:00.559737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:00.560451 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:00.561292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:00.561750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:00.562176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:00.622787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:00.630659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-81319331-618a-4f36-b81e-05f62701e691 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082255 Sep 07 08:18:00.631215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 827/1676] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:00 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:01.066807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:01.067424 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:01.073813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:01.074294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:01.074725 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:01.075409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:01.075859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:01.076830 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:01.205829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:01.213854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d284a0e1-f002-4e3c-9bca-88ba0404e1cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150898 Sep 07 08:18:01.214421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 850/1677] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:01 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:01.653345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:01.653954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:01.661385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:01.661864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:01.662294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:01.662997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:01.663425 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:01.663845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:01.724417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:01.731979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-08e52354-5157-4ccf-b89b-22997dec5455 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082510 Sep 07 08:18:01.732616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 828/1678] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:01 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:02.236563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:02.237154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:02.243652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:02.244165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:02.244606 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:02.245300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:02.245760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:02.246192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:02.377048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:02.385372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1439a94b-bd0b-4147-abcb-72ff46b78ce3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153057 Sep 07 08:18:02.385943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 851/1679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:02 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:02.754688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:02.755329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:02.761795 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:02.762277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:02.762713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:02.763399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:02.764408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:02.764820 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:02.829320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:02.837096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5879a021-467c-4228-8c3f-0cb0acb65703 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086295 Sep 07 08:18:02.837672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 829/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:02 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:03.409457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:03.410070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:03.416966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:03.417453 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:03.417892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:03.418583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:03.419040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:03.419469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:03.546784 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:03.555012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a81a18b8-95c3-431c-bee5-46f3fadcb2e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149517 Sep 07 08:18:03.555575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 852/1681] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:03 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:03.861128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:03.861680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:03.867973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:03.868487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:03.868922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:03.869604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:03.870062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:03.870484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:03.931997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:03.940835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8b2838df-2f90-43a6-b496-cd2fdca7c916 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084422 Sep 07 08:18:03.941408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 830/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:03 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:04.579643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:04.580279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:04.586672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:04.587155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:04.587583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:04.588298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:04.588750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:04.589168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:04.722934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:04.731252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-eae834b2-226d-46eb-a6e6-e1268fce5383 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156230 Sep 07 08:18:04.731832 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 853/1683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:04 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:04.963559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:04.964136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:04.970630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:04.971115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:04.971552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:04.972278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:04.972735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:04.973161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:04.987582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:05.036548 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:05.044165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d19cb61f-3e9e-445b-ab07-c6da38dffb32 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.084540 Sep 07 08:18:05.044724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 831/1684] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:04 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:05.754458 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:05.755003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:05.761337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:05.761819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:05.762253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:05.762942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:05.763392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:05.763887 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:05.890177 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:05.898334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9f089631-ecbd-4939-bc98-1aeeca0c7181 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.147824 Sep 07 08:18:05.898903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 854/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:05 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:18:06.066824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:06.067373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:06.073738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:06.074221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:06.074659 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:06.075347 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:06.075802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:06.076783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:06.288808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:06.296538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b24fb56f-26ff-433b-893c-aa30673578de tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.233596 Sep 07 08:18:06.297098 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 832/1686] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:06 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:06.923400 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:06.924007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:06.930498 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:06.930973 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:06.931401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:06.932108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:06.932557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:06.932975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:07.063616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:07.071909 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-28a3a20c-a448-4049-8453-5cd63cdf1d8f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153052 Sep 07 08:18:07.072496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 855/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:06 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:07.319064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:07.319672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:07.325999 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:07.326600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:07.326959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:07.327642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:07.328111 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:07.328540 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:07.391265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:07.398904 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1ce72323-2e2c-4a21-a307-6ef193519bd4 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083659 Sep 07 08:18:07.399448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 833/1688] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:07 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:08.095166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:08.095780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:08.102242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:08.102743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:08.103163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:08.103859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:08.104342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:08.104776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:08.234936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:08.243081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7db6fe13-3fe9-4a47-a3ae-033a75812b0a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152070 Sep 07 08:18:08.243629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 856/1689] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:08 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:08.423677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:08.424319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:08.426604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=56 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:08.431837 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:08.432353 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:08.432798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:08.433495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:08.433956 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:08.434385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:08.495377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:08.504074 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4999c7f2-2d1a-460b-b022-bedcb4ddfac9 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085041 Sep 07 08:18:08.504656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 834/1690] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:08 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:09.267588 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:09.268249 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:09.270524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=52 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:09.275823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:09.276326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:09.276765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:09.277446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:09.277897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:09.278319 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:09.282982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:09.406099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:09.414535 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1edbe476-3dd4-49a3-aa1a-a9cd49f1c7d6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151610 Sep 07 08:18:09.415110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 857/1691] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:09 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:09.526449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:09.526996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:09.533495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:09.533975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:09.534411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:09.535097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:09.535555 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:09.535978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:09.596553 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:09.604146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a411ef2f-90f6-453b-b69b-5baf2bb2c5bf tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.081628 Sep 07 08:18:09.604695 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 835/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:09 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:18:10.438046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:10.438689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:10.445151 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:10.445633 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:10.446068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:10.446760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:10.447216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:10.447643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:10.576938 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:10.584988 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4efbffa2-d567-4fdc-b21a-c7648d542017 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151065 Sep 07 08:18:10.585581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 858/1693] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:10 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:10.626644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:10.627258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:10.633732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:10.634161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:10.634620 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:10.635308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:10.635761 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:10.636228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:10.697036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:10.705371 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-754e4b29-af72-4d75-a431-0985229ac5db tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082663 Sep 07 08:18:10.705924 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 836/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:10 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:11.607873 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:11.608508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:11.614968 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:11.615460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:11.615899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:11.616636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:11.617095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:11.617525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:11.728397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:11.729209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:11.735444 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:11.735927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:11.736396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:11.737083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:11.737533 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:11.737952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:11.746764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:11.755644 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-879dbe29-1ca8-42cd-878f-bba522d47f14 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151804 Sep 07 08:18:11.756237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 859/1695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:11 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:11.803097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:11.811670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-220aab0e-f625-48b5-a499-1e8a09cc3115 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.087059 Sep 07 08:18:11.812258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 837/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:11 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:18:12.780676 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:12.781292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:12.787720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:12.788245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:12.788682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:12.789373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:12.789827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:12.790253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:12.834745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:12.835320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:12.841827 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:12.842313 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:12.842744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:12.843436 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:12.843889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:12.844345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:12.922441 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:12.930964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-068dab3a-6c42-4c1e-bfd9-e6e9c583f02a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154443 Sep 07 08:18:12.931547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 860/1697] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:12 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:12.937021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:12.945033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-04a4553d-55df-4acf-aa1f-62c26d533b56 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.114089 Sep 07 08:18:12.945582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 838/1698] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:12 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:18:13.955464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:13.956016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:13.962587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:13.963070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:13.963506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:13.964244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:13.964697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:13.965123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:13.967433 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:13.968318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:13.974687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:13.975169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:13.975601 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:13.976324 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:13.976775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:13.977196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:14.039184 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:14.046959 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-21672978-b352-4313-bdd6-897bf8a12a79 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.083804 Sep 07 08:18:14.047513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 839/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:13 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:18:14.099956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:14.108483 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-68037fba-588f-4fbb-aee5-001429337471 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157519 Sep 07 08:18:14.109061 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 861/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:13 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:15.070872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:15.071486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:15.078500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:15.078982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:15.079419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:15.080133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:15.080592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:15.081026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:15.132339 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:15.132956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:15.139934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:15.140447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:15.141078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:15.142014 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:15.142684 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:15.143314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:15.150891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:15.161717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b3c0e3f1-88df-4537-a5a8-fe30fdc74689 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.094661 Sep 07 08:18:15.162518 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 840/1701] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:15 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:15.274597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:15.283515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2ae05f52-0b72-45b9-ba3f-949a852d477d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155927 Sep 07 08:18:15.284102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 862/1702] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:15 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:18:16.186233 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:16.186848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:16.193225 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:16.193712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:16.194153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:16.194848 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:16.195311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:16.195738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:16.258883 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:16.267198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-de8f396f-fb6d-4494-80e9-f1b0e882ef1d tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.085671 Sep 07 08:18:16.267753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 841/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:16 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:16.305597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:16.306205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:16.313442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:16.313920 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:16.314353 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:16.315037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:16.315514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:16.315935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:16.449396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:16.458366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1fee8a2-0706-4679-b4e7-f976595867e6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156588 Sep 07 08:18:16.458932 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 863/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:16 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:17.289487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:17.290096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:17.297193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:17.297672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:17.298103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:17.298784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:17.299232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:17.299650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:17.359999 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:17.367622 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a6b3c04b-0ac6-46d2-8e45-f6ed8393f888 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082377 Sep 07 08:18:17.368209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 842/1705] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:17 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:17.481591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:17.482583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:17.488910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:17.489395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:17.489834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:17.490524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:17.490981 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:17.491405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:17.618240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:17.626568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-77401414-33e0-4ae5-8d3f-1e5a80d492d3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148877 Sep 07 08:18:17.627141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 864/1706] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:17 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:18.390150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:18.390758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:18.397146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:18.397624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:18.398055 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:18.398735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:18.399185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:18.399610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:18.470941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:18.478728 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3e6ca764-dc8a-4412-8e81-fc6ccb5787ac tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.092548 Sep 07 08:18:18.479280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 843/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:18 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:18.650006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:18.650565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:18.657682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:18.658172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:18.658614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:18.659314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:18.659777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:18.660239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:18.791215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:18.799933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38206be5-be8d-48f2-aa2f-337f0d1bf0b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153857 Sep 07 08:18:18.800528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 865/1708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:18 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:19.502113 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:19.502719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:19.509407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:19.509889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:19.510322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:19.511006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:19.511460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:19.511876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:19.572485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:19.580683 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fdd35286-54eb-4647-834c-e32ae34a82b0 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082440 Sep 07 08:18:19.581242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 844/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:19 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:19.824499 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:19.825048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:19.831858 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:19.832375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:19.832818 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:19.833514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:19.833975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:19.834405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:19.961798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:19.970410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8a0e5293-ff6d-4d7d-b51e-9686c1d2f460 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149953 Sep 07 08:18:19.970970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 866/1710] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:19 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:20.603613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:20.604257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:20.610928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:20.611416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:20.611855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:20.612592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:20.613051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:20.613482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:20.678140 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:20.686697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6bd48dbe-3e08-4b82-87ed-d56c5eacc493 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.086971 Sep 07 08:18:20.687246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 845/1711] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:20 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:20.994204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:20.994744 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:21.001655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:21.002146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:21.002587 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:21.003291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:21.003782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:21.004245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:21.132914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:21.141157 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4a82f0f-6fa6-4f4d-968c-444f2ce4e7a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150961 Sep 07 08:18:21.141727 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 867/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:20 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:21.709242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:21.709817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:21.716722 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:21.717196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:21.717631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:21.718316 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:21.718770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:21.719192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:21.779468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:21.787377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-95d552c3-ba93-40ac-b34d-cce4d64e4a6f tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082046 Sep 07 08:18:21.787968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 846/1713] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:21 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:22.164367 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:22.164985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:22.171759 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:22.172277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:22.172717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:22.173407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:22.173863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:22.174287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:22.306445 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:22.315514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f1348d9d-1849-41bb-868d-8ec7d06867ad tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155123 Sep 07 08:18:22.316109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 868/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:22 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:22.810973 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:22.812307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:22.818754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:22.819249 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:22.819689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:22.820417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:22.820876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:22.821304 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:22.881448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:22.889106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b442caca-292e-4b92-a63e-ea7f39701ff3 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1225 microversion: 2.1 time: 0.082290 Sep 07 08:18:22.889791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 847/1715] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:22 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:23.339063 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:23.339616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:23.346653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:23.347143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:23.347580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:23.348307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:23.348836 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:23.349198 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:23.477758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:23.485946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14ef7472-d9a7-42cb-8d36-7e363b04857e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150859 Sep 07 08:18:23.486510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 869/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:23 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:23.912036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:23.912726 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:23.915176 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:18:23.915318 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:18:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac (ip 10.222.0.26) !!! Sep 07 08:18:23.921445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:23.921922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:23.922354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:23.923068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:23.923522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:23.923944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:23.930168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:23.958300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:23.958777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:23.959214 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:23.959654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lazy-loading 'fault' on Instance uuid 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 08:18:23.999613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19af2d1084c14c3ea2df8369855aaed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2744f91a6284e0688af92a926c199d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:24.007627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-21afeed6-1890-4c71-998a-f3b723211f6e tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 200 len: 1230 microversion: 2.1 time: 0.099559 Sep 07 08:18:24.008213 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 848/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:23 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:24.508718 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:24.509263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:24.511406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:18:24.511536 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:18:24.512563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:18:24.512716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:18:24.513540 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:18:24.513669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:18:24.522494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:24.522983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:24.523427 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:24.524150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:24.524613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:24.525043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:24.660398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:24.668626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8bd13760-b82a-43ba-be5b-6d711c45dd36 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.163841 Sep 07 08:18:24.669192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 870/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:24 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:25.031677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:25.032325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] [instance: 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:25.038741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:25.039219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:25.039649 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:25.040369 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:25.040822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:25.041244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:25.054267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] HTTP exception thrown: Instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac could not be found. Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Request method failure captured: Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac HTTP/1.1 Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept: application/json Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Connection: close Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Length: 0 Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Content-Type: application/json Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Host: 10.222.0.26 Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjGFCYZZMtHEv3wXnLFy_SFZUPT_PASRPyAMqEAFBiQH5hnflSSbnK7K0zG560pb04cNm7A5NPy4Zgtj00splY1OdWohp_t4H1-nmdQvJN6JjDy_57Q5zeNGOqr3x-2x3h3kSc2Nl4Y-tTrqJfiwuCcL3B_BVXU-SkC9QF5THO6CzQZ1w Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Id: e2744f91a6284e0688af92a926c199d1 Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-TestVolumeBootPattern-408637989 Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Role: reader,member Sep 07 08:18:25.055875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2744f91a6284e0688af92a926c199d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e2744f91a6284e0688af92a926c199d1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e2744f91a6284e0688af92a926c199d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e2744f91a6284e0688af92a926c199d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-TestVolumeBootPattern-408637989 Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Id: e2744f91a6284e0688af92a926c199d1 Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-TestVolumeBootPattern-408637989 Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User: tempest-TestVolumeBootPattern-408637989-project Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Id: 19af2d1084c14c3ea2df8369855aaed0 Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-TestVolumeBootPattern-408637989-project Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: method: > Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: exception: Instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac could not be found. Sep 07 08:18:25.057740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: action_args: {'id': '27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac'} Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac could not be found. Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 08:18:25.058833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac could not be found. Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac could not be found. Sep 07 08:18:25.060932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Sep 07 08:18:25.062496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Returning 404 to user: Instance 27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 08:18:25.062496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-39c4d9cd-75b2-4f71-b88d-07366f92c409 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac" status: 404 len: 111 microversion: 2.1 time: 0.030393 Sep 07 08:18:25.062496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 849/1719] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:25 2022] GET /compute/v2.1/servers/27bb5df2-c9c4-42b0-be6b-aef15d5dc5ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 08:18:25.692264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:25.692906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:25.699262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:25.699740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:25.700197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:25.700891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:25.701341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:25.701760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:25.828159 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:25.836365 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-66e9c49e-866d-4a2b-a300-e37df4431c88 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.147996 Sep 07 08:18:25.837027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 871/1720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:25 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:26.859628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:26.860275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:26.867062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:26.867550 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:26.867989 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:26.868749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:26.869280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:26.869712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:27.007911 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:27.016587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8569bcdd-3bba-4456-a39f-0821d153f443 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.161642 Sep 07 08:18:27.017138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 850/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:26 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:28.039539 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:28.040154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:28.046842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:28.047329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:28.047764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:28.048487 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:28.048942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:28.049369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:28.175780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:28.183856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-864a1920-aa0e-4d33-89ea-4479e47be12b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148174 Sep 07 08:18:28.184457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 872/1722] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:28 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:29.208794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:29.209407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:29.216018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:29.216524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:29.217104 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:29.218900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:29.219493 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:29.219922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:29.368608 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:29.377344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc08adc9-9698-4e4b-b5ac-02abcdd9b38b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.172379 Sep 07 08:18:29.377914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 851/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:29 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:30.401721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:30.402337 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:30.409541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:30.410030 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:30.410469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:30.411160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:30.411618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:30.412044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:30.544127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:30.546360 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=100 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:30.553537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7174e886-d8e2-4831-b022-c28a3961a99e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155699 Sep 07 08:18:30.554106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 873/1724] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:30 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:31.577662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:31.578275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:31.584694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:31.585172 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:31.585604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:31.586283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:31.586735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:31.587156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:31.718642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:31.726737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-44bc0cf6-0212-4236-af46-494374f2e341 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153004 Sep 07 08:18:31.727300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 852/1725] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:31 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:32.750790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:32.751415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:32.758082 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:32.758571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:32.759013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:32.759710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:32.760205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:32.760635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:32.890610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:32.898721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-35ca6503-525a-40b4-aa5f-9957b498f279 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152433 Sep 07 08:18:32.899293 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 874/1726] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:32 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:33.922271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:33.922881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:33.929413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:33.929891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:33.930322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:33.931006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:33.931455 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:33.931876 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:34.058954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:34.067521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-77d344ee-390b-4ef6-b6fe-bf8ac29244cc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149185 Sep 07 08:18:34.068088 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 853/1727] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:33 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:35.091135 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:35.091703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:35.098776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:35.099256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:35.099689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:35.100412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:35.100888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:35.101335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:35.240779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:35.250366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-aea8c3a5-7c5a-4b88-b323-4f6e86c2d574 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.163206 Sep 07 08:18:35.250944 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 875/1728] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:35 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:36.273896 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:36.274545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:36.281376 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:36.281858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:36.282299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:36.283014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:36.283471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:36.283894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:36.416349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:36.425900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-53e2e0dd-1779-4aa6-8dab-9bf103fd67e9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155869 Sep 07 08:18:36.426463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 854/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:36 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:37.449788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:37.450412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:37.457838 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:37.458324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:37.458764 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:37.459457 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:37.459916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:37.460377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:37.588843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:37.597008 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c67e72c5-2583-48a9-937a-373a7b9b1582 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151150 Sep 07 08:18:37.597573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 876/1730] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:37 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:38.619934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:38.620565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:38.622842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=44 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:38.628786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:38.629265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:38.629699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:38.630385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:38.630841 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:38.631266 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:38.758549 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:38.767320 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f0f97c67-2ba1-4f0f-8a75-5f031d74f7c4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151318 Sep 07 08:18:38.767878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 855/1731] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:38 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:39.790461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:39.791041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:39.793505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=40 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:39.799553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:39.800036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:39.800493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:39.801196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:39.801654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:39.802076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:39.932385 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:39.940857 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f4adc564-cd9c-459b-9395-32f02a05ba3b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154524 Sep 07 08:18:39.941418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 877/1732] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:39 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:40.964379 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:40.964923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:40.971898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:40.972408 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:40.972838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:40.973526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:40.973974 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:40.974393 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:41.102937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:41.111721 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c6787fb5-67a3-4af4-b339-d0ef79c24b44 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151289 Sep 07 08:18:41.112303 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 856/1733] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:40 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:42.135056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:42.135669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:42.142775 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:42.143257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:42.143700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:42.144425 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:42.144881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:42.145310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:42.275926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:42.285148 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-93655f52-bc2c-4194-8785-5a267e37d761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154061 Sep 07 08:18:42.285809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 878/1734] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:42 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:43.308280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:43.308893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:43.316177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:43.316663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:43.317096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:43.317784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:43.318232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:43.318681 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:43.452302 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:43.460811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9a6ae180-6da6-488f-9fbf-88de26dd4e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156415 Sep 07 08:18:43.461546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 857/1735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:43 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:44.484867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:44.485514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:44.491965 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:44.492482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:44.492917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:44.493610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:44.494070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:44.494500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:44.623242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:44.631817 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-22b888f7-3fd7-499a-83b4-3e753a1d68ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151472 Sep 07 08:18:44.632408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 879/1736] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:44 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:45.655026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:45.655611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:45.662019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:45.662495 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:45.662928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:45.663606 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:45.664057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:45.664512 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:45.794059 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:45.803083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3ca50799-fe25-4abe-8b01-36b6532549ac tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151897 Sep 07 08:18:45.803651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 858/1737] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:45 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:46.826821 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:46.827974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:46.834598 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:46.835077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:46.835512 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:46.836228 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:46.836682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:46.837104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:46.967892 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:46.976506 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6972564a-904c-4e4c-a582-fd746e3f5de4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153504 Sep 07 08:18:46.977074 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 880/1738] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:46 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:47.999460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:48.000118 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:48.006474 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:48.006953 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:48.007385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:48.008072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:48.008564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:48.008968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:48.138796 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:48.147368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f2a4ddd0-d4aa-4b9b-b686-e07e6e6a5fc1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151812 Sep 07 08:18:48.147928 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 859/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:47 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:49.171570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:49.172213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:49.178622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:49.179105 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:49.179542 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:49.180262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:49.180721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:49.181147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:49.310656 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:49.318951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-60aef6f9-35ba-4918-aa03-cc1cd52785a5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151917 Sep 07 08:18:49.319509 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 881/1740] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:49 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:50.341605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:50.342212 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:50.349126 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:50.349604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:50.350062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:50.350826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:50.351278 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:50.351696 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:50.487562 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:50.496028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3488431c-ce07-483f-8857-3f69647622ec tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.158264 Sep 07 08:18:50.496814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 860/1741] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:50 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:51.521181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:51.521808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:51.527694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:51.528200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:51.528635 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:51.529318 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:51.529773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:51.530217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:51.658362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:51.666443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5b5f2574-6f42-42a6-93a8-186b7c50de94 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149351 Sep 07 08:18:51.667006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 882/1742] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:51 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:52.690941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:52.691657 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:52.698111 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:52.698594 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:52.699033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:52.699727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:52.700222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:52.700653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:52.832571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:52.840630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fa3ddc3b-97f2-45a8-bb62-63eab640f5bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154520 Sep 07 08:18:52.841189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 861/1743] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:52 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:53.864593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:53.865126 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:53.871525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:53.872006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:53.872469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:53.873155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:53.873611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:53.874525 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:54.004949 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:54.013154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ad29689a-d74f-43bd-aad8-12f272dc3e0e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152598 Sep 07 08:18:54.013720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 883/1744] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:53 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:55.036975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:55.037611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:55.043653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:55.044168 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:55.044605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:55.045288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:55.045778 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:55.046242 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:55.050067 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=82 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:18:55.182790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:55.192171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-79fabfff-b0d3-45c2-99ac-2c6fa6991a99 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.158998 Sep 07 08:18:55.192730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 862/1745] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:55 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:56.214762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:56.215372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:56.222494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:56.222975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:56.223440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:56.224143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:56.224597 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:56.225018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:56.352528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:56.360654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f3a6a7f5-b9b7-412b-8426-0aed37818aa7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149801 Sep 07 08:18:56.361222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 884/1746] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:56 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:18:57.385975 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:57.386404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:57.392757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:57.393237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:57.393672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:57.394360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:57.394813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:57.395237 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:57.522383 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:57.531944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ee8994c7-bee6-4971-8875-7ff39ce5297f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151599 Sep 07 08:18:57.532557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 863/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:57 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:58.556090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:58.556710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:58.564099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:58.564589 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:58.565022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:58.565705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:58.566187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:58.566608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:58.695943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:58.704603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-598616b8-5dd3-4114-a123-6a093d8b4973 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152449 Sep 07 08:18:58.705184 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 885/1748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:58 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:18:59.727689 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:18:59.728350 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:18:59.735559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:59.736039 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:59.736508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:59.737196 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:18:59.737650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:18:59.738075 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:18:59.870834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:18:59.879169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-325ae968-2c15-406d-98bd-8c34547a60b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155242 Sep 07 08:18:59.879737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 864/1749] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:18:59 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:00.903227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:00.903799 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:00.910384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:00.910866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:00.911301 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:00.911987 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:00.912467 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:00.912893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:01.040563 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:01.049507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-47933cfe-2d89-4750-aa69-c901d08bb372 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151020 Sep 07 08:19:01.050077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 886/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:00 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:02.073161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:02.073805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:02.080842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:02.081322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:02.081758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:02.082445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:02.082900 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:02.083327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:02.210076 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:02.218338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2ac59f73-62ff-4e6a-8854-59d84ee431a0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149026 Sep 07 08:19:02.218898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 865/1751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:02 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:03.242383 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:03.242998 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:03.249486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:03.250076 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:03.250522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:03.251220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:03.251680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:03.252130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:03.255972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=80 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:03.384171 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:03.393062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-33988b9e-7459-4f08-849a-3da2fc7e43ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154585 Sep 07 08:19:03.393627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 887/1752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:03 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:04.415832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:04.416472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:04.423664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:04.424183 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:04.424618 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:04.425314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:04.425770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:04.426197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:04.559231 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:04.567644 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6ab54c96-109b-42f2-8037-67555800ec5e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155702 Sep 07 08:19:04.568224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 866/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:04 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:05.590872 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:05.591482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:05.598541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:05.599022 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:05.599464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:05.600193 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:05.600647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:05.601073 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:05.729036 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:05.737822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a177292f-a5c5-4b68-9b8d-314ec0a89f34 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150859 Sep 07 08:19:05.738394 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 888/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:05 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:06.761089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:06.761703 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:06.768373 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:06.768857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:06.769295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:06.769996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:06.770453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:06.770878 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:06.900808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:06.909238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7b66e8ad-d775-4b80-abb9-3c4b4df21e30 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152104 Sep 07 08:19:06.909806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 867/1755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:06 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:07.933027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:07.933561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:07.940948 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:07.941437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:07.941877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:07.942584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:07.943079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:07.943510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:08.073997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:08.083075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b9810f1d-487b-42b6-af24-98155d9c6668 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154032 Sep 07 08:19:08.083634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 889/1756] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:07 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:09.105954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:09.106516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:09.108948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:09.114826 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:09.115336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:09.115780 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:09.116496 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:09.116952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:09.117378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:09.247151 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:09.255178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-48638a94-122d-4873-b4d1-f4d74d9546f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153212 Sep 07 08:19:09.255729 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 868/1757] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:09 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:10.278545 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:10.279139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:10.281583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:10.287777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:10.288310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:10.288750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:10.289443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:10.289896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:10.290322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:10.424475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:10.432740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c2ab457-a527-48e9-88d9-2754aa6a0d58 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.158092 Sep 07 08:19:10.433304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 890/1758] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:10 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:11.456587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:11.457199 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:11.463576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:11.464040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:11.464510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:11.465224 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:11.465682 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:11.466108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:11.596356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:11.604449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3dec30d7-7c4e-41d4-891f-992ff57defed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152087 Sep 07 08:19:11.605011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 869/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:11 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:12.628569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:12.629182 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:12.635651 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:12.636158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:12.636591 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:12.637275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:12.637723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:12.638145 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:12.766083 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:12.774272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-93b3439a-d06c-484f-ab60-dbd491ccffa1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150125 Sep 07 08:19:12.774840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 891/1760] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:12 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:13.797675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:13.798423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:13.804870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:13.805357 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:13.805786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:13.806467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:13.806917 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:13.807339 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:13.933851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:13.942719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b06dce5b-3989-4368-9210-3c98b839b92b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148997 Sep 07 08:19:13.943272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 870/1761] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:13 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:14.966253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:14.966816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:14.973996 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:14.974478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:14.974906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:14.975590 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:14.976038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:14.976482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:15.108616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:15.117521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ad432a3c-2c5b-4033-8318-7e3b3ea3c7f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155205 Sep 07 08:19:15.120123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 892/1762] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:14 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:16.140187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:16.140813 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:16.147291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:16.147811 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:16.148306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:16.149002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:16.149461 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:16.149890 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:16.283305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:16.291467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eab62559-c7e5-4c06-b687-90b44ef2ccde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155167 Sep 07 08:19:16.292029 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 871/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:16 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:17.315575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:17.316244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:17.322612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:17.323095 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:17.323532 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:17.324255 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:17.324713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:17.325140 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:17.452908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:17.461165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-db9d05cf-7d39-4152-87f5-8aca953bc286 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150133 Sep 07 08:19:17.461734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 893/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:17 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:18.484067 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:18.484705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:18.491254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:18.491732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:18.492189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:18.492868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:18.493317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:18.493739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:18.620434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:18.629259 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0cbb3d49-a68d-4513-ade8-ddf41a8aeaaa tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149004 Sep 07 08:19:18.629819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 872/1765] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:18 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:19.652123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:19.652746 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:19.660123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:19.660613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:19.661054 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:19.661748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:19.662204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:19.662634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:19.797773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:19.805840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3da47d81-53c3-40de-b4ed-8c1d3f4104ca tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157620 Sep 07 08:19:19.806398 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 894/1766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:19 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:20.829338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:20.829952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:20.836554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:20.837058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:20.837476 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:20.838161 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:20.838615 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:20.839037 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:20.971468 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:20.979651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cdbbccce-2a99-4177-9ea5-110903f9c0b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154203 Sep 07 08:19:20.980245 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 873/1767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:20 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:22.002913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:22.003516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:22.009561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:22.010045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:22.010481 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:22.011173 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:22.011625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:22.012051 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:22.140682 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:22.149833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6650b66d-177d-474d-bd9d-684471a06c1a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151017 Sep 07 08:19:22.150403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 895/1768] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:21 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:23.173865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:23.174473 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:23.180892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:23.181378 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:23.181810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:23.182492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:23.182939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:23.183356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:23.318677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:23.326652 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fbad049e-92c5-4173-a882-c05ff26f7c49 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157513 Sep 07 08:19:23.327209 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 874/1769] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:23 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:24.463599 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:24.464263 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:24.471165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:24.471647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:24.472102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:24.472811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:24.473297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:24.473722 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:24.600212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:24.608475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bec4b450-c38f-4cdc-bc8f-50b7f34602b9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.261467 Sep 07 08:19:24.609221 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 896/1770] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:24 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:25.632250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:25.632864 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:25.638847 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:25.639329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:25.639765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:25.640481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:25.641490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:25.642100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:25.645939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=78 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:25.773955 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:25.782914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e41362f8-007e-41bb-a16d-cea8326c61c9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154810 Sep 07 08:19:25.783472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 875/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:25 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:26.806543 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:26.807152 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:26.814470 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:26.814945 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:26.815377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:26.816062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:26.816531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:26.816952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:26.948050 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:26.956343 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-29c997f4-2308-4d74-9a1e-02d36cf0c421 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153745 Sep 07 08:19:26.956911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 897/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:26 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:27.979399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:27.980017 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:27.987068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:27.987554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:27.987996 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:27.988735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:27.989193 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:27.989619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:28.131486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:28.139747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-274995a5-1804-4405-bf3c-4b2502d8d879 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.164300 Sep 07 08:19:28.140343 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 876/1773] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:27 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:29.164614 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:29.165217 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:29.175156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:29.176695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:29.177145 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:29.178787 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:29.179253 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:29.179686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:29.318954 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:29.330806 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f503bb2a-c938-4d4f-bdf5-74f2ab5df0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.170854 Sep 07 08:19:29.331756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 898/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:29 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:30.356128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:30.356678 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:30.364219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:30.364708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:30.365144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:30.365835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:30.366288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:30.366716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:30.495777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:30.504000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8a7d542e-f87b-410e-8215-7f0598668274 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151894 Sep 07 08:19:30.504591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 877/1775] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:30 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:31.527119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:31.527728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:31.534254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:31.534729 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:31.535160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:31.535842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:31.536322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:31.536745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:31.667044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:31.675802 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b728875c-2936-43e3-ad09-b378aef3d0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152543 Sep 07 08:19:31.676403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 899/1776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:31 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:32.699034 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:32.699670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:32.706819 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:32.707319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:32.707751 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:32.708453 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:32.708905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:32.709326 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:32.838943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:32.847291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-747dde0a-f8df-4995-9151-2079c0970476 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152106 Sep 07 08:19:32.847851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 878/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:32 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:33.871143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:33.871717 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:33.878442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:33.878923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:33.879357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:33.880042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:33.880519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:33.880942 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:33.888798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=78 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:34.012344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:34.021023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-df5880c1-6fa5-47d5-a93b-81207cc72660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153845 Sep 07 08:19:34.021594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 900/1778] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:33 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:35.044525 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:35.045139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:35.054253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:35.054981 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:35.055700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:35.056921 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:35.057723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:35.058489 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:35.191937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:35.200171 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-420443f9-f1c9-48dd-b8ce-5a71ca1cc8f8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.159511 Sep 07 08:19:35.200730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 879/1779] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:35 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:36.223377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:36.224002 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:36.230406 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:36.230884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:36.231313 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:36.231995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:36.232473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:36.232896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:36.367114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:36.375444 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17ab5755-df4b-40b5-b233-59af755337b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156001 Sep 07 08:19:36.376011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 901/1780] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:36 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:37.398189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:37.398805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:37.405285 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:37.405708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:37.406661 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:37.407346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:37.407800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:37.408254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:37.535219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:37.543361 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8470a6bd-0b8d-4758-a7f3-e61621b1a4ef tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149054 Sep 07 08:19:37.543914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 880/1781] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:37 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:38.566850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:38.567483 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:38.574282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:38.574762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:38.575190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:38.575906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:38.576435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:38.576854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:38.706226 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:38.714345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2b511b6b-e61c-42e3-9d83-34f466fcfd3c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151845 Sep 07 08:19:38.714904 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 902/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:38 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:39.738201 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:39.738727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:39.741124 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:39.746592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:39.747107 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:39.747541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:39.748256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:39.748709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:39.749130 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:39.882732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:39.890935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8a163ac5-69e0-4842-83b7-ed720985dfe9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157426 Sep 07 08:19:39.891497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 881/1783] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:39 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:40.913782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:40.914503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:40.916846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:40.922672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:40.923106 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:40.923546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:40.924278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:40.924735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:40.925164 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:41.057059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:41.066629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4439cb4a-b8b0-41ff-8426-d6a2620bfc97 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156702 Sep 07 08:19:41.067216 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 903/1784] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:40 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:42.090655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:42.091267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:42.099143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:42.099632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:42.100070 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:42.100783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:42.101244 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:42.101673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:42.230556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:42.239257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b33f73d1-c11b-4bcb-9914-02a6d39ca7fc tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152477 Sep 07 08:19:42.239814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 882/1785] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:42 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:43.262146 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:43.262786 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:43.270723 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:43.271213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:43.271649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:43.272377 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:43.272837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:43.273265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:43.405515 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:43.413811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-076bef94-c0aa-4a85-a4b9-643e40f4d6ff tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155743 Sep 07 08:19:43.414379 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 904/1786] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:43 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:44.438277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:44.439057 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:44.445384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:44.445874 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:44.446310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:44.446999 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:44.447452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:44.447881 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:44.577970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:44.586725 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8314c50-3796-4112-9be7-6262df15077b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152837 Sep 07 08:19:44.587284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 883/1787] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:44 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:45.611706 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:45.612335 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:45.618891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:45.619378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:45.619822 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:45.620554 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:45.621016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:45.621449 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:45.748486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:45.756925 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8206b1fd-0b59-4fbe-ae6a-e8647cacb268 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149982 Sep 07 08:19:45.757492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 905/1788] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:45 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:46.785546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:46.786157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:46.792948 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:46.793424 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:46.793857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:46.794538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:46.794988 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:46.795409 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:46.925204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:46.933406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc4678fe-fec1-489d-a2b0-c8fba06f3eb0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152293 Sep 07 08:19:46.933972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 884/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:46 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:47.956692 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:47.957342 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:47.963456 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:47.963940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:47.964412 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:47.965102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:47.965557 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:47.965983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:48.101955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:48.110612 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-394ee8be-fdf4-4fb4-8139-f628579d355d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157363 Sep 07 08:19:48.111174 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 906/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:47 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:49.133109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:49.133714 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:49.140063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:49.140567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:49.141079 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:49.142338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:49.142789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:49.143212 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:49.271120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:49.279331 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ff6f4621-f0cb-404d-9999-a95b32226752 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150068 Sep 07 08:19:49.279886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 885/1791] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:49 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:50.303437 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:50.304041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:50.310693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:50.311168 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:50.311596 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:50.312306 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:50.312757 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:50.313219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:50.452494 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:50.461187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-6296b718-2ec6-4761-ae22-75f5a1c22abe tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.161597 Sep 07 08:19:50.461748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 907/1792] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:50 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:51.484593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:51.485843 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:51.492296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:51.492779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:51.493215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:51.493898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:51.494352 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:51.494777 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:51.626487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:51.634599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1276d264-d04b-4a37-914f-af86a1aa5d8b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153989 Sep 07 08:19:51.635170 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 886/1793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:51 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:52.658333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:52.658947 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:52.664885 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:52.665366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:52.665801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:52.666486 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:52.666941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:52.667364 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:52.795899 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:52.805045 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8dca2aea-e4b1-4b6c-807b-772894c8982d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150787 Sep 07 08:19:52.805613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 908/1794] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:52 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:53.828477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:53.829093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:53.835416 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:53.835897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:53.836423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:53.837115 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:53.837572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:53.837997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:53.968050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:53.976723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-20a843ac-497e-4965-a0f9-858d3feb7911 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152147 Sep 07 08:19:53.977284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 887/1795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:53 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:55.000888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:55.002131 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:55.008369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:55.008874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:55.009310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:55.009992 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:55.010445 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:55.010865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:55.140827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:55.149067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a472eaff-87e7-4e0b-9e47-3e964aa7893a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152133 Sep 07 08:19:55.149634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 909/1796] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:54 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:56.174235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:56.174856 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:56.181384 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:56.181870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:56.182307 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:56.182998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:56.183456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:56.183888 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:56.186716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=78 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:19:56.316192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:56.324932 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-74689bdf-db4d-4ae5-836f-edce307e8197 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155432 Sep 07 08:19:56.325486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 888/1797] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:56 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:57.347498 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:57.348123 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:57.354755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:57.355240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:57.355680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:57.356401 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:57.356856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:57.357279 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:57.486199 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:57.494356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9d36d3cc-94dc-4a84-9883-954fc45e5988 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150727 Sep 07 08:19:57.494923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 910/1798] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:57 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:58.518542 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:58.519158 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:58.525621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:58.526111 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:58.526552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:58.527248 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:58.527712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:58.528169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:58.658032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:58.666699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dc584ff3-205b-4b7e-b62b-378151283cd8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152632 Sep 07 08:19:58.667255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 889/1799] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:58 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:19:59.691363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:19:59.692172 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:19:59.698307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:59.698783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:59.699215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:59.699903 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:19:59.700378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:19:59.700801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:19:59.836952 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:19:59.845524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-712e8d2c-404d-4381-8671-c0b713eef72a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.158191 Sep 07 08:19:59.846093 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 911/1800] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:19:59 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:00.869011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:00.869627 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:00.877300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:00.877438 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:00.877898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:00.878858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:00.879509 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:00.880036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:01.015832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:01.024143 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6f883181-d451-406f-983b-1f7ea164ea9f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.158984 Sep 07 08:20:01.024691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 890/1801] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:00 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:02.047846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:02.048583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:02.054982 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:02.055459 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:02.055891 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:02.056601 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:02.057052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:02.057472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:02.185225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:02.194225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5d7a27f5-57f0-42e6-8d68-95c0d117ce15 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150408 Sep 07 08:20:02.194785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 912/1802] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:02 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:03.217455 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:03.218051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:03.224679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:03.225179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:03.225613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:03.226306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:03.226758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:03.227181 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:03.359969 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:03.368862 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7723ec34-16b3-41d2-9547-5aec63ea1531 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155258 Sep 07 08:20:03.369429 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 891/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:03 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:04.391178 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:04.391914 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:04.398808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:04.399285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:04.399712 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:04.400421 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:04.400866 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:04.401282 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:04.405147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=78 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:04.531357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:04.540734 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-50d6b4ab-522f-487b-a382-f3975684b7b2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153486 Sep 07 08:20:04.541303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 913/1804] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:04 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:05.564773 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:05.565382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:05.567375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:20:05.567511 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:20:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:20:05.568497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:20:05.568648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:20:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:20:05.576439 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:05.576917 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:05.577349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:05.578032 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:05.578482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:05.579559 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:05.706833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:05.714927 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-815d61c8-1062-4132-9574-d4eac23e5a78 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154583 Sep 07 08:20:05.715488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 892/1805] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:05 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:06.737530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:06.738127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:06.744585 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:06.745048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:06.745477 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:06.746160 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:06.746609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:06.747029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:06.875114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:06.883537 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c3cc41af-f8fb-4826-8335-25c2ef455806 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149926 Sep 07 08:20:06.884150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 914/1806] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:06 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:07.906471 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:07.907687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:07.914198 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:07.914675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:07.915103 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:07.915794 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:07.916276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:07.916699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:08.047136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:08.056040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22730ec9-c945-4c5a-9f2b-f7556ad48502 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153415 Sep 07 08:20:08.056629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 893/1807] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:07 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:09.078906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:09.079454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:09.086121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:09.086605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:09.087047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:09.087758 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:09.088220 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:09.088649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:09.217326 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:09.226037 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-afc89c31-c6de-47de-ad37-e3ead807e08b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151089 Sep 07 08:20:09.235929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 915/1808] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:09 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:10.250487 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:10.251097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:10.253964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:10.259284 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:10.259763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:10.260272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:10.260963 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:10.261414 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:10.261831 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:10.392922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:10.401096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-951c00c3-ea54-43f9-8e6f-3b435bd57967 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154596 Sep 07 08:20:10.401648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 894/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:10 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:11.424955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:11.425556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:11.427850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:11.432906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:11.433390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:11.433828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:11.434770 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:11.435224 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:11.435649 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:11.568227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:11.576373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-26ea11b6-e7d7-484c-911b-4e26edbf0ff3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155434 Sep 07 08:20:11.576941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 916/1810] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:11 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:12.601323 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:12.601872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:12.608337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:12.608815 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:12.609263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:12.609961 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:12.610417 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:12.610846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:12.746441 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:12.755102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-334c6206-cdd7-40d5-a3b3-4f4f37f83043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157973 Sep 07 08:20:12.755672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 895/1811] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:12 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:13.779127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:13.779672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:13.786783 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:13.787270 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:13.787707 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:13.788435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:13.788894 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:13.789324 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:13.916402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:13.925289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7d783368-0508-46ec-916f-ed18cc45b623 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150056 Sep 07 08:20:13.925860 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 917/1812] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:13 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:14.948648 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:14.949177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:14.955651 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:14.956175 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:14.956614 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:14.957305 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:14.957760 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:14.958186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:15.091280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:15.099314 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a1ded6e9-8d54-4e75-b08c-b47704f91166 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154627 Sep 07 08:20:15.099867 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 896/1813] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:14 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:16.128372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:16.128986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:16.135461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:16.135943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:16.136443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:16.137161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:16.137628 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:16.138047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:16.270228 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:16.278350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3c08378c-8bc1-478e-84e3-6fed6814de7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154492 Sep 07 08:20:16.278919 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 918/1814] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:16 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:17.302256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:17.302858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:17.309741 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:17.310222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:17.310665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:17.311359 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:17.311814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:17.312269 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:17.482576 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:17.491109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ac71a4ac-554a-45e6-8daa-95724a341c4a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.193218 Sep 07 08:20:17.491680 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 897/1815] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:17 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:18.514846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:18.515461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:18.522272 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:18.522760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:18.523195 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:18.523896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:18.524380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:18.524811 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:18.652071 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:18.661112 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-462a4b3a-8329-4ca7-a880-ecd7c664b51a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150137 Sep 07 08:20:18.661683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 919/1816] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:18 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:19.683838 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:19.684734 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:19.692025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:19.692528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:19.692965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:19.693646 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:19.694097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:19.694524 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:19.825109 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:19.833852 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c0d7caa7-f377-44ba-a811-c1d00628a6a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153844 Sep 07 08:20:19.834423 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 898/1817] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:19 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:20.857329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:20.857941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:20.865236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:20.865724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:20.866161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:20.866861 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:20.867314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:20.867735 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:20.999519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:21.008422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fc6a36fe-dcd6-4f70-b50d-105daeaca5bd tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154921 Sep 07 08:20:21.008985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 920/1818] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:20 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:22.030870 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:22.031480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:22.037866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:22.038344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:22.038771 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:22.039448 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:22.039897 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:22.040345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:22.167236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:22.175300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-921b7942-8a9e-4293-bdfd-6097281db86e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148357 Sep 07 08:20:22.175791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 899/1819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:22 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:23.198975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:23.199581 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:23.205955 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:23.206460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:23.207451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:23.208183 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:23.208636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:23.209057 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:23.390336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:23.400210 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e36a89c6-3019-4dd7-80f7-0e7d607e0c52 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.204959 Sep 07 08:20:23.400765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 921/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:23 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:24.424297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:24.424941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:24.431965 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:24.432516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:24.433068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:24.434056 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:24.434516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:24.434935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:24.564593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:24.573445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-680b3d99-02db-425f-b171-8aac00b19f5f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153196 Sep 07 08:20:24.574010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 900/1821] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:24 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:25.596392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:25.597006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:25.603347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:25.603824 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:25.604292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:25.604976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:25.605426 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:25.605850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:25.732886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:25.741839 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4961e0cd-e700-4198-b977-056438eefd22 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149324 Sep 07 08:20:25.742397 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 922/1822] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:25 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:26.765972 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:26.766613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:26.784723 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:26.785221 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:26.785641 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:26.786337 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:26.786789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:26.787211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:26.789853 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=78 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:26.919255 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:26.927875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8cbdb76f-3494-4ec8-baeb-c36d515f3918 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.165789 Sep 07 08:20:26.928463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 901/1823] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:26 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:27.951961 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:27.952641 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:27.959878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:27.960388 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:27.960829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:27.961524 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:27.961984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:27.962413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:28.092837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:28.101009 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a220764c-0902-403e-abf3-10a140c09991 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152934 Sep 07 08:20:28.101574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 923/1824] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:27 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:29.124120 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:29.124663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:29.131191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:29.131672 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:29.132134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:29.132823 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:29.133279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:29.133736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:29.272750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:29.280894 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f49ad3ae-90e0-44eb-9cb9-7ce9f5938043 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.160829 Sep 07 08:20:29.281449 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 902/1825] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:29 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:30.305100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:30.305792 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:30.312500 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:30.312984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:30.313420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:30.314115 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:30.314573 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:30.314995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:30.444251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:30.452766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba4f5e44-f884-45d6-bf9c-4ab81059f829 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152254 Sep 07 08:20:30.453328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 924/1826] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:30 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:31.475744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:31.476383 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:31.483600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:31.484101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:31.484546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:31.485272 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:31.485753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:31.486177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:31.617144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:31.625177 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-af27036f-adc4-4ab8-8c9d-33377fc139ed tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153271 Sep 07 08:20:31.625738 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 903/1827] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:31 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:32.649386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:32.649930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:32.656442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:32.656926 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:32.657362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:32.658046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:32.658504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:32.658934 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:32.788906 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:32.797038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cb824329-0d6d-4ecb-975a-18ac056354ae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151581 Sep 07 08:20:32.797600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 925/1828] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:32 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:33.821510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:33.822116 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:33.828697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:33.829187 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:33.829631 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:33.830325 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:33.830781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:33.831207 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:33.957241 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:33.965544 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6a48d61b-8600-4a00-922e-9c997067d075 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.147866 Sep 07 08:20:33.966106 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 904/1829] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:33 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:34.988874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:34.989415 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:34.995748 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:34.996262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:34.996695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:34.997372 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:34.997820 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:34.998238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:35.000785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=78 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:35.130451 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:35.138530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-84b63a5c-b391-4917-bc60-b14a87cbe981 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153589 Sep 07 08:20:35.139093 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 926/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:34 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:36.161546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:36.162166 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:36.168643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:36.169128 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:36.169565 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:36.170256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:36.170710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:36.171136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:36.306735 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:36.315150 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2fbfbcfb-f9dd-49a0-9c12-d0db2b192648 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157682 Sep 07 08:20:36.315712 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 905/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:36 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:37.338782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:37.339392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:37.345789 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:37.346267 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:37.346700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:37.348103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:37.348559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:37.348984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:37.479503 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:37.487626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-304edb44-1b71-4e19-b944-5734cd9fd92a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152757 Sep 07 08:20:37.488482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 927/1832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:37 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:38.510795 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:38.511415 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:38.517842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:38.518327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:38.518766 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:38.519482 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:38.519946 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:38.520406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:38.645892 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:38.654036 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e2fe700f-22ba-436f-b71c-96973d0ce940 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.147237 Sep 07 08:20:38.654605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 906/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:38 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:39.678067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:39.678695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:39.685273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:39.685754 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:39.686190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:39.686876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:39.687329 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:39.687753 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:40.047558 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:40.056409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-946a7167-9b66-488f-9316-9b19a42827a8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.382902 Sep 07 08:20:40.056974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 928/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:39 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:41.078577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:41.079189 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:41.081505 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:41.087089 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:41.087593 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:41.088011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:41.088732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:41.089191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:41.089621 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:41.219180 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:41.227572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-488dcd3d-4f2f-484a-83b4-be02ce9b97f6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152830 Sep 07 08:20:41.228146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 907/1835] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:41 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:42.251117 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:42.251738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:42.254050 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:42.260166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:42.260652 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:42.261084 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:42.261781 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:42.262242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:42.262665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:42.390147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:42.399132 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba48b07f-4af8-4222-9e26-6b71dfe38c7a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151897 Sep 07 08:20:42.399705 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 929/1836] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:42 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:43.421877 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:43.422513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:43.429789 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:43.430277 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:43.430713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:43.431691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:43.432182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:43.432613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:43.563216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:43.571310 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1ee98ba0-a2fa-4e82-923b-4e519c94ffb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153355 Sep 07 08:20:43.571866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 908/1837] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:43 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:44.594130 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:44.594741 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:44.601384 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:44.601869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:44.602305 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:44.603010 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:44.603446 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:44.603870 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:44.733779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:44.742574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e616413-07f3-4749-88f7-fc0c1eead7b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152333 Sep 07 08:20:44.743133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 930/1838] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:44 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:45.766203 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:45.766854 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:45.773985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:45.774467 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:45.774898 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:45.775587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:45.776040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:45.776485 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:45.905915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:45.915742 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8cb726ff-261a-4ff4-99d4-5e1d9d230cc9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153477 Sep 07 08:20:45.916336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 909/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:45 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:46.938410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:46.939019 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:46.946278 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:46.946755 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:46.947187 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:46.947874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:46.948356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:46.948778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:47.075762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:47.084274 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-14f0508c-8177-48d2-b1c8-71460edf0d4f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149346 Sep 07 08:20:47.084846 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 931/1840] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:46 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:48.106758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:48.107375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:48.113750 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:48.114227 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:48.114660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:48.115338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:48.115790 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:48.116236 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:48.249730 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:48.258679 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-91df4c1b-8e8e-434a-8ed8-ca05d1ebeed7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155797 Sep 07 08:20:48.259232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 910/1841] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:48 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:49.282300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:49.282908 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:49.290300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:49.290782 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:49.291211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:49.291895 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:49.292366 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:49.292788 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:49.424325 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:49.432574 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a8001815-4146-4068-bcab-4039aaa93fb6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154094 Sep 07 08:20:49.433145 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 932/1842] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:49 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:50.455822 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:50.456460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:50.462905 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:50.463377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:50.463814 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:50.464529 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:50.464983 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:50.465406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:50.595739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:50.604687 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0aebb296-74c3-4dc2-861b-d59449ece57d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152820 Sep 07 08:20:50.605246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 911/1843] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:50 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:51.628402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:51.629013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:51.635465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:51.635880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:51.636341 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:51.637026 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:51.637475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:51.637897 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:51.776139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:51.784244 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a9e11589-4996-4c9d-a2ab-125625d05bfb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.159804 Sep 07 08:20:51.784801 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 933/1844] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:51 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:52.806979 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:52.807597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:52.814279 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:52.814765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:52.815204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:52.815893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:52.816381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:52.816808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:52.948984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:52.957145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f6251827-ea6f-4e7a-9ebf-ccf9ccd1c7ab tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154025 Sep 07 08:20:52.957709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 912/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:52 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:53.981104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:53.981675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:53.988058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:53.988567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:53.988995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:53.989680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:53.990218 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:53.990662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:54.117549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:54.125695 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-561c664d-ce32-4bf5-be91-a71bea23155e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148546 Sep 07 08:20:54.126264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 934/1846] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:53 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:55.148799 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:55.149802 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:55.156190 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:55.156673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:55.157111 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:55.157806 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:55.158263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:55.158690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:55.288886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:55.297129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1289dbca-b1dc-43a3-9219-e181c759500e tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152376 Sep 07 08:20:55.298238 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 913/1847] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:55 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:56.321056 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:56.321670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:56.328238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:56.328719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:56.329154 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:56.329841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:56.330298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:56.330815 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:56.462749 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:56.470886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2fd32093-d577-4b65-9b75-a031f03b6148 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154313 Sep 07 08:20:56.471450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 935/1848] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:56 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:57.494146 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:57.494752 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:57.501188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:57.501668 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:57.502101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:57.502781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:57.503228 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:57.503647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:57.506200 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=78 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:20:57.635334 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:57.643494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a96cfcf1-481a-4fa8-9cd1-688dc9d1b70a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.153189 Sep 07 08:20:57.644049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 914/1849] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:57 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:58.667196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:58.667738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:58.674180 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:58.674657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:58.675088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:58.675768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:58.676251 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:58.676672 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:58.802953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:58.811347 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2aa2a33f-3977-47ef-aa0a-ef57187cb676 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148063 Sep 07 08:20:58.811915 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 936/1850] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:58 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:20:59.835792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:20:59.836387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:20:59.842702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:59.843184 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:59.843616 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:59.844340 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:20:59.844784 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:20:59.845197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:20:59.975670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:20:59.984122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-73519bc6-077d-4f14-b13d-53575ba2e2b6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152906 Sep 07 08:20:59.984677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 915/1851] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:20:59 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:01.007075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:01.007647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:01.014062 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:01.014541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:01.014975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:01.015666 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:01.016150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:01.016572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:01.152546 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:01.160716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-501cb2ca-0fc7-4a2f-90fe-5a7e413a08ee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.157706 Sep 07 08:21:01.161983 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 937/1852] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:01 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:02.184311 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:02.184947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:02.191556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:02.192068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:02.192526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:02.193936 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:02.194396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:02.194817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:02.323421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:02.331491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85d873a4-3df6-4892-a057-de6d9982924b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151378 Sep 07 08:21:02.332043 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 916/1853] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:02 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:03.355016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:03.355675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:03.362039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:03.362516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:03.362946 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:03.363629 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:03.364092 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:03.364517 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:03.494780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:03.502922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7b2ca4a7-251e-400d-be3a-ef1bfceb847a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151757 Sep 07 08:21:03.503485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 938/1854] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:03 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:04.526630 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:04.527240 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:04.534078 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:04.534557 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:04.534990 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:04.535670 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:04.536147 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:04.536791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:04.669000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:04.677865 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-369f78d0-e0b3-455d-b9e7-9bd25e8ceeba tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154333 Sep 07 08:21:04.678632 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 917/1855] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:04 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:05.701338 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:05.701979 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:05.709040 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:05.709713 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:05.710150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:05.710841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:05.711299 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:05.711726 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:05.714280 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=78 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:05.839174 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:05.847291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4d5f2f93-e047-402e-a6b0-0f71ba2ec236 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.149884 Sep 07 08:21:05.847854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 939/1856] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:05 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:06.871997 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:06.872694 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:06.879064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:06.879545 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:06.879987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:06.880769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:06.881219 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:06.881642 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:07.008538 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:07.016643 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ece3b6e0-88b8-4245-a6b8-f3ae1ad7f6a7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.148843 Sep 07 08:21:07.017204 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 918/1857] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:06 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:08.040264 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:08.040874 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:08.047356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:08.047833 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:08.048294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:08.048980 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:08.049431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:08.049848 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:08.180307 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:08.188602 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-348002e4-2d95-49ab-97e1-631fac91cfa9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.152811 Sep 07 08:21:08.189167 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 940/1858] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:08 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:09.210868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:09.211475 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:09.217846 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:09.218329 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:09.218762 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:09.219445 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:09.219895 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:09.220345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:09.352832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:09.361149 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83a2c08b-07a7-44f3-b3b9-0db7b9fdbe1d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.154320 Sep 07 08:21:09.361716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 919/1859] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:09 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:10.386190 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:10.386807 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:10.393277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:10.393760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:10.394204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:10.394896 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:10.395350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:10.395881 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:10.524828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:10.532999 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e1092d7b-69fd-40bb-95db-f2013cf93bc5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150735 Sep 07 08:21:10.533570 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 941/1860] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:10 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:11.556094 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:11.556715 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:11.559276 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:11.564665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:11.565142 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:11.565573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:11.566256 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:11.566733 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:11.567156 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:11.694727 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:11.702793 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-91a436e1-c1d4-49ac-a09c-cbcf6af57e87 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150655 Sep 07 08:21:11.703354 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 920/1861] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:11 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:12.727225 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:12.727864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:12.730237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=26 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:12.735510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:12.735997 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:12.736460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:12.737156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:12.737611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:12.738041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:12.871194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:12.879403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d9430dce-4644-4843-b24e-e4ccc4874f42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.156940 Sep 07 08:21:12.880831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 942/1862] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:12 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:13.904031 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:13.904690 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:13.911185 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:13.911770 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:13.912243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:13.912945 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:13.913404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:13.913833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:14.042265 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:14.050380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e9368038-0340-4c6a-bb10-b290f4d7ab27 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.150183 Sep 07 08:21:14.050950 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 921/1863] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:13 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:15.074779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:15.075311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:15.081809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:15.082294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:15.082728 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:15.084205 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:15.084664 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:15.085120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:15.214710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:15.222790 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3581383e-1e91-4ff4-b707-d7438a3e5103 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151996 Sep 07 08:21:15.223357 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 943/1864] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:15 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:16.245805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:16.246356 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:16.252700 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:16.253174 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:16.253629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:16.254338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:16.254925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:16.255380 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:16.384914 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:16.393054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5bd61903-d049-47a6-b816-4b40ee758713 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.151166 Sep 07 08:21:16.393610 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 922/1865] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:16 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:17.416460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:17.417099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:17.424693 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:17.425176 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:17.425608 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:17.426292 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:17.426742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:17.427159 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:17.559654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:17.568386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-b988b967-70e2-43c2-b28d-9ea32481694b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1560 microversion: 2.1 time: 0.155806 Sep 07 08:21:17.568956 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 944/1866] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:17 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:18.099664 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-0b1fcd3a-ec9b-42df-b2ed-c5f09f941a95 req-ef2caaec-0ae1-4276-94d8-d6d2b8bc6f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe19217f-e207-4d14-ab09-b60b3f86d950", "name": "network-vif-deleted", "tag": "26e8b2e2-43fc-4676-bfe2-2cb84a23f272"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 08:21:18.109400 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-0b1fcd3a-ec9b-42df-b2ed-c5f09f941a95 req-ef2caaec-0ae1-4276-94d8-d6d2b8bc6f15 service nova] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:18.109879 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-0b1fcd3a-ec9b-42df-b2ed-c5f09f941a95 req-ef2caaec-0ae1-4276-94d8-d6d2b8bc6f15 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:18.110317 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-0b1fcd3a-ec9b-42df-b2ed-c5f09f941a95 req-ef2caaec-0ae1-4276-94d8-d6d2b8bc6f15 service nova] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:18.121829 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-0b1fcd3a-ec9b-42df-b2ed-c5f09f941a95 req-ef2caaec-0ae1-4276-94d8-d6d2b8bc6f15 service nova] Creating event network-vif-deleted:26e8b2e2-43fc-4676-bfe2-2cb84a23f272 for instance fe19217f-e207-4d14-ab09-b60b3f86d950 on hv-cinder-83602 Sep 07 08:21:18.128063 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-0b1fcd3a-ec9b-42df-b2ed-c5f09f941a95 req-ef2caaec-0ae1-4276-94d8-d6d2b8bc6f15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094281 Sep 07 08:21:18.128719 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 923/1867] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 7 08:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 08:21:18.591933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:18.592600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:18.600070 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:18.600583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:18.601028 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:18.601732 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:18.602191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:18.602627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:18.664222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:18.672405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-12e9bd6c-2171-4ae1-8be9-b3de6f4c497a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084393 Sep 07 08:21:18.672970 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 945/1868] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:18 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:19.696432 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:19.697133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:19.703833 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:19.704349 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:19.704792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:19.705484 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:19.705939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:19.706365 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:19.769064 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:19.777377 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a3a04942-bcda-4a64-8792-fc482cca45a3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086110 Sep 07 08:21:19.777925 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 924/1869] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:19 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:20.800552 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:20.801165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:20.808169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:20.808907 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:20.809344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:20.810034 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:20.810490 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:20.810917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:20.874304 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:20.883295 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-16d88317-3ee4-4b9a-815c-864f033db458 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086673 Sep 07 08:21:20.883863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 946/1870] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:20 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:21.906212 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:21.906832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:21.913375 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:21.913855 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:21.914292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:21.914987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:21.915443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:21.915868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:21.977724 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:21.985882 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ad6d9e3c-dd12-40db-9609-184ef907e58a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083535 Sep 07 08:21:21.986443 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 925/1871] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:21 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:23.009035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:23.009580 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:23.015950 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:23.016469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:23.016905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:23.017594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:23.018047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:23.018472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:23.079242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:23.088137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-1bbc0aef-80b5-46c4-bea8-fb942670872a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083189 Sep 07 08:21:23.088703 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 947/1872] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:23 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:24.111355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:24.111954 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:24.118093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:24.118574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:24.119007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:24.119688 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:24.120165 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:24.120589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:24.181817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:24.190257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a5b2d96b-e48c-4f4e-a704-7bd64a0fb04a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082747 Sep 07 08:21:24.190849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 926/1873] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:24 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:25.214200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:25.214791 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:25.221122 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:25.221600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:25.222035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:25.222716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:25.223165 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:25.223582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:25.289007 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:25.297204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9a5db70d-0090-428e-8248-a77739e4f0b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086839 Sep 07 08:21:25.297780 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 948/1874] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:25 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:21:26.321061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:26.321673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:26.328049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:26.328567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:26.328998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:26.329677 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:26.330127 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:26.330547 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:26.394977 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:26.403271 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b12b3b9b-f627-4684-b1fd-be851481125d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086236 Sep 07 08:21:26.403828 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 927/1875] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:26 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:27.426236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:27.426842 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:27.434328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:27.434808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:27.435239 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:27.435923 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:27.436420 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:27.436843 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:27.497880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:27.507044 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a2103ad-5dac-4bd1-93ea-e19427297c7f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084690 Sep 07 08:21:27.507601 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 949/1876] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:27 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:28.530344 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:28.530967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:28.538135 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:28.538617 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:28.539054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:28.539744 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:28.540230 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:28.540660 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:28.544629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=80 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:28.603810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:28.611984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d0a34caa-2b0d-492d-8b30-82295eed5c2f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085493 Sep 07 08:21:28.612574 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 928/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:28 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:29.635018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:29.635556 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:29.642066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:29.642548 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:29.642984 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:29.643674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:29.644155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:29.644582 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:29.705930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:29.715052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a57a3d22-98a3-4aff-aff3-bffcaa153533 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084074 Sep 07 08:21:29.715627 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 950/1878] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:29 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:30.737967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:30.738607 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:30.745704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:30.746178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:30.746609 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:30.747286 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:30.747736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:30.748188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:30.810835 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:30.819899 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d972c543-8fb4-4b94-a2ee-2f6a09811b54 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085783 Sep 07 08:21:30.820508 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 929/1879] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:30 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:31.843447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:31.844100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:31.851185 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:31.851665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:31.852116 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:31.852809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:31.853289 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:31.853710 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:31.915495 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:31.923622 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7cfbb581-6b0a-44c5-8b1d-b6fc0dfa35f0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084067 Sep 07 08:21:31.924191 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 951/1880] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:31 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:32.946650 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:32.947360 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:32.953919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:32.954413 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:32.954849 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:32.955558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:32.956016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:32.956464 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:33.023336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:33.032591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8e5fefed-16f3-461f-8ca8-aba4afe38725 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.089442 Sep 07 08:21:33.033169 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 930/1881] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:32 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:34.060960 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:34.061600 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:34.067985 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:34.068492 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:34.068927 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:34.069610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:34.070060 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:34.070482 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:34.134223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:34.142375 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-67a61eda-30a3-4d66-ba59-090c0f0f5409 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085782 Sep 07 08:21:34.142940 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 952/1882] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:34 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:35.165665 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:35.166295 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:35.173100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:35.173653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:35.174141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:35.174995 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:35.175460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:35.175986 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:35.241121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:35.249463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b5b26c2d-87ff-4034-b9ef-926218a009c0 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.088275 Sep 07 08:21:35.250054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 931/1883] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:35 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:36.272751 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:36.273369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:36.279855 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:36.280380 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:36.280819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:36.281516 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:36.281978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:36.282408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:36.284951 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:36.346144 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:36.354409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8fa63cd3-9f35-4afb-b3e1-ca09c3df702a tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086279 Sep 07 08:21:36.354976 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 953/1884] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:36 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:37.377547 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:37.378141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:37.385422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:37.385909 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:37.386345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:37.387042 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:37.387494 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:37.387918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:37.449052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:37.457159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5aa5aeee-981f-44ef-ac08-c0f881a1e1f9 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083453 Sep 07 08:21:37.457713 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 932/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:37 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:38.480632 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:38.481241 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:38.487663 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:38.488102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:38.488549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:38.489250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:38.490252 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:38.490669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:38.551047 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:38.560029 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2670c587-d543-43de-a40a-d14c4232de46 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083320 Sep 07 08:21:38.560613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 954/1886] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:38 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:39.582213 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:39.582736 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:39.589512 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:39.589998 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:39.590437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:39.591129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:39.591591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:39.592018 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:39.654636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:39.662858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a6c2f3e0-c028-43b7-9da5-c514459ca1f4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084599 Sep 07 08:21:39.663419 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 933/1887] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:39 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:40.685916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:40.686522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:40.693639 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:40.694111 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:40.694541 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:40.695222 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:40.695673 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:40.696110 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:40.758196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:40.766352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cbf817b4-f9eb-4557-8996-a38eedf02c2d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084638 Sep 07 08:21:40.766922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 955/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:40 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:41.790497 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:41.791050 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:41.793336 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:41.798396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:41.798884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:41.799322 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:41.800014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:41.800498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:41.800922 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:41.862456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:41.870781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e83acb0b-725c-437f-95ef-7beb510d2b59 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084974 Sep 07 08:21:41.871338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 934/1889] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:41 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:42.894464 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:42.895083 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:42.898078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:42.903390 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:42.903877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:42.904355 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:42.905048 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:42.905504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:42.905929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:42.972141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:42.981052 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ab53fcee-cc4f-4348-8a26-d7b865522b7c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.090503 Sep 07 08:21:42.981618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 956/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:42 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:21:44.004568 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:44.005355 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:44.011753 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:44.012387 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:44.012825 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:44.013516 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:44.013970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:44.014398 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:44.080291 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:44.088889 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cda66eae-1004-4444-88e6-c830105d39b3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.088172 Sep 07 08:21:44.089447 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 935/1891] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:43 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:45.113042 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:45.113593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:45.116179 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:21:45.116322 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:21:45.118013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:21:45.118141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:21:45.119348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:21:45.119508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: Wed Sep 7 08:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:21:45.131166 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:45.131648 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:45.132101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:45.132816 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:45.133271 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:45.133697 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:45.197977 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:45.206243 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-20217b5e-bc53-49e4-abbb-8f4b20631dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.097209 Sep 07 08:21:45.206805 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 957/1892] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:45 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:46.230134 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:46.230747 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:46.233534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:21:46.233666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:21:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 (ip 10.222.0.26) !!! Sep 07 08:21:46.241887 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:46.242403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:46.242858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:46.243561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:46.244016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:46.244469 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:46.306935 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:46.315292 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-66903ac2-309f-4c59-9084-555c16e4b8de tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.089130 Sep 07 08:21:46.315851 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 936/1893] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:46 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:47.338733 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:47.339344 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:47.345793 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:47.346277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:47.346714 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:47.347409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:47.347863 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:47.348376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:47.409508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:47.418340 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-a0311176-5021-452f-97d8-d7b9d66df00c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083521 Sep 07 08:21:47.418916 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 958/1894] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:47 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:48.441396 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:48.442129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:48.448756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:48.449229 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:48.449666 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:48.450346 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:48.450798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:48.451253 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:48.515693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:48.524480 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-02b0bff8-ccc5-4e2a-b7e8-01cc197391bb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086891 Sep 07 08:21:48.525040 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 937/1895] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:48 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:49.547404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:49.548016 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:49.554596 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:49.555075 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:49.555507 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:49.556228 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:49.556683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:49.557104 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:49.619854 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:49.627856 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9db1e32c-f4b0-485e-b610-f1f60c95c616 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084297 Sep 07 08:21:49.628447 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 959/1896] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:49 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:50.651381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:50.651947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:50.658460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:50.658939 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:50.659372 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:50.660049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:50.660523 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:50.661510 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:50.721971 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:50.730655 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-40056c20-73d5-4057-9dcf-871c4e77fe70 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083212 Sep 07 08:21:50.731217 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 938/1897] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:50 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:51.753206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:51.753779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:51.760209 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:51.760701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:51.761138 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:51.761829 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:51.762287 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:51.762720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:51.826941 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:51.835626 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-69671d9e-453c-4bad-856d-599df263eede tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086407 Sep 07 08:21:51.836227 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 960/1898] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:51 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:52.858315 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:52.858934 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:52.865481 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:52.865968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:52.866406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:52.867097 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:52.867551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:52.867976 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:52.932192 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:52.940492 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b5b16897-fb8c-4b83-acd9-61456eb35700 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085999 Sep 07 08:21:52.941051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 939/1899] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:52 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:53.964634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:53.965238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:53.971568 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:53.972043 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:53.972514 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:53.973819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:53.974273 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:53.974694 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:54.035465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:54.044362 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-c2dcd2ba-7f7e-4c9e-aeba-1a15aad51516 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083581 Sep 07 08:21:54.044922 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 961/1900] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:53 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:55.067294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:55.067868 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:55.073985 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:55.074470 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:55.074907 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:55.075597 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:55.076068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:55.076520 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:55.371619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:55.380009 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b5b33e0-e824-4bd1-98e1-52e39d913569 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.316757 Sep 07 08:21:55.380604 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 940/1901] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:55 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:56.403819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:56.404454 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:56.411359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:56.411837 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:56.412291 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:56.412978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:56.413427 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:56.413845 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:56.475576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:56.483610 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-544973b7-0848-4b4f-ba95-d6ee2f49e405 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083670 Sep 07 08:21:56.484212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 962/1902] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:56 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:57.507100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:57.507717 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:57.514157 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:57.514645 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:57.515083 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:57.515785 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:57.516274 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:57.516705 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:57.578791 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:57.587544 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d7bd7b54-5fdb-4eff-a10a-ac123f424dae tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084575 Sep 07 08:21:57.588129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 941/1903] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:57 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:58.611156 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:58.611766 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:58.618288 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:58.618765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:58.619196 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:58.619878 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:58.620351 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:58.620773 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:58.682038 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:58.690592 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-cf3168d7-5e4e-46a8-be1b-9d90baa6d0a2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083353 Sep 07 08:21:58.691158 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 963/1904] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:58 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:21:59.714624 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:21:59.715619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:21:59.725091 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:59.725579 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:59.726013 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:59.726708 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:21:59.727159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:21:59.727577 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:21:59.730179 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:21:59.791817 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:21:59.799908 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-82ecbeb4-b228-4274-b1c2-ac104fc5bfee tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.089476 Sep 07 08:21:59.800503 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 942/1905] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:21:59 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:00.823391 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:00.824006 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:00.830489 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:00.830974 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:00.831410 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:00.832716 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:00.833262 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:00.833738 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:00.897336 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:00.906419 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2db78004-14b9-4b23-9c64-eab828ea0747 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086842 Sep 07 08:22:00.907079 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 964/1906] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:00 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:01.930399 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:01.931068 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:01.937792 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:01.938269 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:01.938702 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:01.939381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:01.939832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:01.940283 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:02.007327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:02.015603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-62e7fdc3-3d01-4a14-8729-6dd1a7ef420d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.089696 Sep 07 08:22:02.016178 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 943/1907] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:01 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:03.039565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:03.040150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:03.047277 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:03.047762 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:03.048231 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:03.048928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:03.049381 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:03.049840 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:03.111403 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:03.119522 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-38845160-1283-418c-afbc-7b9a35035dde tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084640 Sep 07 08:22:03.120100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 965/1908] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:03 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:04.142845 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:04.143452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:04.149967 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:04.150444 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:04.150873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:04.151552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:04.152002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:04.152450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:04.215933 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:04.224582 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d4e0e1d9-3660-44fc-95ad-64eb9c101299 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085662 Sep 07 08:22:04.225141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 944/1909] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:04 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:05.246800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:05.247392 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:05.254081 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:05.254638 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:05.255103 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:05.255800 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:05.256298 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:05.256724 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:05.321521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:05.329720 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2c6ed6f9-2938-4826-be9a-10f570fb75a4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086825 Sep 07 08:22:05.336242 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 966/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:05 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:06.353591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:06.354208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:06.360673 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:06.361162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:06.361605 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:06.362303 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:06.362765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:06.363872 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:06.425058 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:06.434558 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b7022951-929f-43f6-9716-0dea504b12c3 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084915 Sep 07 08:22:06.435125 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 945/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:06 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:07.457827 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:07.458465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:07.465102 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:07.465584 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:07.466015 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:07.466700 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:07.467150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:07.467572 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:07.471396 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:22:07.529017 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:07.537831 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-015524a5-9d4f-4e27-8847-a7f5992152e7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083925 Sep 07 08:22:07.538402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 967/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:07 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:08.561312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:08.561926 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:08.568653 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:08.569136 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:08.569573 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:08.570263 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:08.570718 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:08.571144 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:08.633033 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:08.641406 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7378d7b8-8abf-44fd-a469-114cd8af4e71 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084122 Sep 07 08:22:08.641919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 946/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:08 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:09.664834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:09.665443 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:09.671862 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:09.672364 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:09.672798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:09.673479 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:09.673929 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:09.674349 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:09.738508 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:09.746605 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-704337ac-a59a-4cd3-89a6-26ce093ab2b7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085714 Sep 07 08:22:09.747169 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 968/1914] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:09 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:10.773537 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:10.774147 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:10.780532 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:10.781011 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:10.781440 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:10.782121 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:10.782571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:10.782991 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:10.844993 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:10.853737 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-06bc0a2f-31f6-4d39-ae05-353d0a38ede8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084218 Sep 07 08:22:10.854300 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 947/1915] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:10 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:11.877852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:11.878402 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:11.885547 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:11.886027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:11.886455 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:11.887142 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:11.887593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:11.888012 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:11.949812 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:11.958250 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-2fa207ed-a5d0-46b9-a08d-3c445c7a17b1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084374 Sep 07 08:22:11.958813 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 969/1916] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:11 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:12.981407 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:12.982020 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:12.984472 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:22:12.990081 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:12.990567 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:12.991004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:12.991699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:12.992188 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:12.992619 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:13.058978 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:13.067308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-69d5811d-2ebd-49ff-9646-55ef0791b281 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.089787 Sep 07 08:22:13.067866 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 948/1917] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:12 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:14.090294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:14.090864 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:14.093275 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:22:14.099127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:14.099611 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:14.100053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:14.100778 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:14.101240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:14.101671 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:14.169463 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:14.181108 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-98327cda-fc3c-4fe5-b64b-14a4065bffcf tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.094715 Sep 07 08:22:14.181701 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 970/1918] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:14 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:15.204182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:15.204832 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:15.211397 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:15.211884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:15.212358 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:15.213053 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:15.213514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:15.213944 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:15.274885 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:15.283000 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-860f46c0-6525-420c-a521-de21a0887571 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082748 Sep 07 08:22:15.283564 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 949/1919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:15 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:16.306865 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:16.307408 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:16.314077 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:16.314577 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:16.314995 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:16.315683 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:16.316435 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:16.316867 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:16.379505 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:16.388163 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7a7501c2-4163-4dc7-b7bd-f46cee3a3f25 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085186 Sep 07 08:22:16.389090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 971/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:16 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:17.411382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:17.412023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:17.418586 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:17.419076 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:17.419514 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:17.420246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:17.420704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:17.421133 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:17.483096 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:17.492046 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-80a34357-8752-45a4-aad7-388f549b3dea tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085126 Sep 07 08:22:17.492667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 950/1921] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:17 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:18.514609 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:18.515256 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:18.522334 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:18.522819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:18.523254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:18.523953 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:18.524440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:18.524869 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:18.593285 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:18.602465 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-058c1f62-878b-444a-af61-4af21b81d590 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.091782 Sep 07 08:22:18.603046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 972/1922] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:18 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:19.625003 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:19.625612 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:19.631966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:19.632490 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:19.632923 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:19.633613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:19.634071 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:19.634499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:19.696749 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:19.705129 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-595d48c9-b2dc-471f-a292-4abac106e01f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083970 Sep 07 08:22:19.705693 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 951/1923] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:19 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:20.728931 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:20.729553 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:20.735930 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:20.736440 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:20.736877 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:20.737785 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:20.738254 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:20.738674 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:20.798880 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:20.807078 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-7852454b-97a6-4d6d-9582-3d9de79d56fb tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082034 Sep 07 08:22:20.807636 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 973/1924] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:20 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:21.829943 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:21.830569 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:21.838019 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:21.838507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:21.838947 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:21.839756 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:21.840257 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:21.840699 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:21.905211 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:21.914223 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-521a8950-3d5b-4f71-a712-ce9daf3be660 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.088175 Sep 07 08:22:21.914779 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 952/1925] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:21 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:22.937859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:22.938472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:22.945090 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:22.945613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:22.946053 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:22.946750 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:22.947213 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:22.947643 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:23.008819 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:23.016966 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-3cc00ffd-455e-44d7-a3d6-742b96c15b29 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083017 Sep 07 08:22:23.017531 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 974/1926] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:22 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:24.041123 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:24.041740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:24.047884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:24.048404 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:24.048840 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:24.049526 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:24.049987 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:24.050411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:24.111197 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:24.119411 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1c27d3e4-609c-4868-afe7-952f1f78e138 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082358 Sep 07 08:22:24.119966 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 953/1927] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:24 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:25.142370 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:25.142986 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:25.149603 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:25.150085 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:25.150519 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:25.151206 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:25.151665 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:25.152099 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:25.215001 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:25.223975 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-62d57cc6-b653-462c-a8d6-00631e761e31 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085516 Sep 07 08:22:25.224578 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 975/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:25 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:26.245710 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:26.246339 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:26.252781 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:26.253327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:26.253916 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:26.254611 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:26.255072 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:26.255501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:26.316739 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:26.324786 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f0e43e33-6de4-4da4-9a8a-0578f1eb6573 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082984 Sep 07 08:22:26.325345 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 954/1929] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:26 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:27.347655 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:27.348240 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:27.354528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:27.355003 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:27.355436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:27.356141 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:27.356593 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:27.357013 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:27.421670 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:27.430348 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-bb67d031-2c58-4bba-ab53-5e4501728966 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086630 Sep 07 08:22:27.430911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 976/1930] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:27 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:28.456787 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:28.457629 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:28.464101 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:28.464587 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:28.465021 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:28.465706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:28.466159 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:28.466592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:28.528581 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:28.537216 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3a06a0a0-0593-4f54-9e4b-384357eda39d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084934 Sep 07 08:22:28.537775 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 955/1931] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:28 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:29.560155 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:29.560834 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:29.567300 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:29.567779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:29.568245 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:29.568936 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:29.569386 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:29.569808 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:29.632967 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:29.641065 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-96390227-d9fd-426a-ab18-c728d65e5c18 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085061 Sep 07 08:22:29.641567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 977/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:29 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:30.664232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:30.664844 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:30.671280 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:30.671763 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:30.672222 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:30.672915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:30.673374 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:30.673800 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:30.676363 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:22:30.738716 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:30.746818 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-37d18ed0-3c6a-4e08-af4a-811cceeeb15c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086617 Sep 07 08:22:30.747382 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 956/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:30 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:31.770361 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:31.770978 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:31.777431 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:31.777918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:31.778356 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:31.779066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:31.779504 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:31.779928 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:31.840794 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:31.848911 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-13d312a0-af8f-4e81-bd94-afbd978e194b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083076 Sep 07 08:22:31.849475 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 978/1934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:31 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:32.871656 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:32.872319 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:32.879368 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:32.879842 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:32.880316 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:32.881006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:32.881462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:32.881886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:32.943952 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:32.952145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3273cd92-42c6-4ed5-8c79-3e5579b2cf05 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084338 Sep 07 08:22:32.952709 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 957/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:32 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:33.975559 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:33.976200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:33.982561 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:33.983039 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:33.983469 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:33.984194 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:33.984647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:33.985068 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:34.048943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:34.057654 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-fff0ed84-b50a-4ceb-824b-c8d0b74d2e93 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086582 Sep 07 08:22:34.058478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 979/1936] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:33 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:35.079919 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:35.080501 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:35.087765 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:35.088290 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:35.088732 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:35.089422 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:35.089880 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:35.090308 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:35.151093 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:35.161886 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5dfb8270-ec62-4962-87d4-f135ff58d1b4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085959 Sep 07 08:22:35.162452 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 958/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:35 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:36.186910 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:36.187530 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:36.194653 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:36.195137 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:36.195576 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:36.196310 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:36.196776 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:36.197204 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:36.260660 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:36.269545 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-8e3abbab-74d4-42bd-ae7d-26f7e957214f tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086792 Sep 07 08:22:36.270101 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 980/1938] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:36 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:37.292031 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:37.292675 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:37.299012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:37.299498 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:37.299938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:37.300647 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:37.301100 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:37.301528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:37.362521 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:37.370572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-120843d2-3368-46b0-bf83-5c7b8d7e6a2c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082448 Sep 07 08:22:37.371125 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 959/1939] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:37 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:38.393613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:38.394223 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:38.400625 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:38.401100 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:38.401529 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:38.402212 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:38.402662 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:38.403080 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:38.406913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:22:38.466297 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:38.474943 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ae6760cd-0f54-4a8e-ad55-aa89a1588104 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085178 Sep 07 08:22:38.475498 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 981/1940] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:38 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:39.498940 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:39.499546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:39.506086 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:39.506551 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:39.506984 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:39.507667 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:39.508139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:39.508561 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:39.573628 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:39.582153 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6281991b-752d-4edb-8658-f9ef71da2ba2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.087466 Sep 07 08:22:39.583069 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 960/1941] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:39 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:40.606114 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:40.606731 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:40.614127 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:40.614618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:40.615067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:40.615765 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:40.616265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:40.616698 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:40.678378 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:40.686743 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-39f7280e-22a9-41e8-b792-9f3065b7018c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084561 Sep 07 08:22:40.687311 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 982/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:40 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:41.710084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:41.710638 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:41.717016 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:41.717499 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:41.717937 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:41.718625 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:41.719080 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:41.719507 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:41.782267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:41.790500 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2000fd57-dfa2-4f25-a091-2ccd34759641 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084847 Sep 07 08:22:41.791052 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 961/1943] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:41 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:42.814407 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:42.815680 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:42.822139 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:42.822619 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:42.823058 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:42.823740 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:42.824219 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:42.824640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:42.885918 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:42.894917 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-252bc907-654c-4796-8571-43cf3f3b7830 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084425 Sep 07 08:22:42.895493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 983/1944] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:42 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:43.918220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:43.918834 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:43.921182 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:22:43.927637 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:43.928147 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:43.928591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:43.929327 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:43.929783 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:43.930208 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:43.992873 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:44.001394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2307a7b6-358f-4165-b286-fd8b69060761 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.087053 Sep 07 08:22:44.001938 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 962/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:43 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:45.024571 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:45.025121 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:45.027433 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:22:45.032769 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:45.033265 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:45.034476 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:45.035376 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:45.035826 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:45.036312 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:45.123471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:45.132692 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d5974f37-8684-49cf-a9ee-d3874e5ab685 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.112125 Sep 07 08:22:45.133257 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 984/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:45 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:46.155745 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:46.156403 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:46.163554 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:46.163970 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:46.164434 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:46.165139 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:46.165592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:46.166014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:46.227654 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:46.236122 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9759f8da-8265-4c89-9e92-8f0080a24c00 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084260 Sep 07 08:22:46.236686 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 963/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:46 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:47.258756 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:47.259369 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:47.265886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:47.266373 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:47.266809 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:47.267501 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:47.268669 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:47.269098 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:47.331023 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:47.339153 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-e73e8ac6-a17e-4c04-8d5a-174342da7733 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084219 Sep 07 08:22:47.339719 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 985/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:47 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:48.361808 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:48.362446 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:48.368858 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:48.369338 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:48.369772 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:48.370456 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:48.370910 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:48.371335 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:48.437023 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:48.445258 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9ca4d77b-48d8-4979-812e-1896329cbd42 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.087491 Sep 07 08:22:48.445757 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 964/1949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:48 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:49.469066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:49.469675 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:49.476868 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:49.477345 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:49.477777 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:49.478460 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:49.478912 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:49.479328 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:49.543852 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:49.552024 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5eb27b8e-d21a-4b8c-bbe5-35e9d81478c2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086748 Sep 07 08:22:49.552616 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 986/1950] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:49 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:50.575084 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:50.575623 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:50.582131 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:50.582613 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:50.583051 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:50.583740 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:50.584235 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:50.584662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:50.646215 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:50.654254 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1feb4892-38d2-430b-84d5-6b7bbab399e5 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083120 Sep 07 08:22:50.654810 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 965/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:50 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:51.677510 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:51.678143 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:51.684565 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:51.685041 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:51.685471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:51.686147 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:51.686594 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:51.687011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:51.747468 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:51.755691 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-0e00926f-f2e7-41bd-a571-c07804fb3527 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082170 Sep 07 08:22:51.756314 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 987/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:51 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:52.778663 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:52.779275 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:52.786546 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:52.787025 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:52.787460 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:52.788180 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:52.788636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:52.789062 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:52.849918 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:52.858028 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-de05afdb-88b4-48d7-baa3-3e74bb38d0f2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083268 Sep 07 08:22:52.858595 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 966/1953] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:52 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:53.881583 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:53.882197 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:53.888642 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:53.889119 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:53.889549 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:53.890237 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:53.890687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:53.891109 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:53.956853 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:53.964962 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d55291fc-d899-44ee-87d3-5ef021027b4b tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.087565 Sep 07 08:22:53.965528 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 988/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:53 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:54.991824 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:54.992462 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:54.998381 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:54.998861 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:54.999294 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:54.999982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:55.000486 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:55.000893 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:55.064014 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:55.072321 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d183d480-68f5-4377-872a-e77e100a1020 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084708 Sep 07 08:22:55.073154 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 967/1955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:54 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:56.100618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:56.101150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:56.107472 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:56.107954 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:56.108473 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:56.109162 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:56.109618 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:56.110046 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:56.171422 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:56.180261 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-ba4a0162-cf67-4f7a-a102-9599d2086bf8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083660 Sep 07 08:22:56.180823 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 989/1956] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:56 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:22:57.203640 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:57.204288 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:57.211054 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:57.211541 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:57.211982 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:57.212704 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:57.213162 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:57.213591 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:57.277691 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:57.286639 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dd37cddd-bb52-4d3f-82be-2793d976b5d1 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086956 Sep 07 08:22:57.287186 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 968/1957] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:57 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:58.310964 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:58.311607 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:58.318302 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:58.318779 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:58.319211 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:58.319893 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:58.320368 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:58.320814 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:58.382471 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:58.390768 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-17e73394-bd19-43e3-9cea-ae20b558580c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084225 Sep 07 08:22:58.391333 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 990/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:58 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:22:59.414491 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:22:59.415102 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:22:59.421530 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:59.422012 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:59.422450 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:59.423145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:22:59.423603 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:22:59.424026 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:22:59.485420 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:22:59.494048 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d221bd5e-b025-48e2-b8ad-5380547816b8 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083365 Sep 07 08:22:59.494552 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 969/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:22:59 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:00.516886 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:00.517478 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:00.523954 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:00.524461 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:00.524890 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:00.525569 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:00.526018 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:00.526436 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:00.587828 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:00.596161 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-427e9c34-38e0-46a3-8eba-60d17747c6d7 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083104 Sep 07 08:23:00.597303 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 991/1960] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:00 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:01.619513 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:01.620138 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:01.626528 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:01.627007 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:01.627437 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:01.628141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:01.628592 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:01.629010 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:01.631483 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=84 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:23:01.690477 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:01.698520 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-70c9d65f-26e3-457b-976c-abb7e7c367ce tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082926 Sep 07 08:23:01.699082 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 970/1961] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:01 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:02.722640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:02.723236 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:02.729575 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:02.730059 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:02.730496 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:02.731181 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:02.731640 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:02.732066 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:02.795745 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:02.804721 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-27cdf411-d5a6-43c3-94d7-dccf072d8da6 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086958 Sep 07 08:23:02.805286 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 992/1962] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:02 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:03.828108 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:03.828706 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:03.835148 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:03.835636 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:03.836092 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:03.836805 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:03.837267 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:03.837697 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:03.898566 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:03.906720 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3c01fc51-3849-442c-a8cf-d8d1b3318456 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.082648 Sep 07 08:23:03.907306 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 971/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:03 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:04.929689 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:04.930290 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:04.936935 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:04.937413 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:04.937841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:04.938521 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:04.938972 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:04.939395 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:05.002027 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:05.010798 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-d1b05480-10f4-4fd5-8074-be17ad7da29d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085030 Sep 07 08:23:05.011363 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 993/1964] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:04 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:06.034126 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:06.034915 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:06.041394 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:06.041875 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:06.042312 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:06.043004 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:06.043463 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:06.043891 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:06.107297 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:06.116006 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-39d90fee-0acd-4b90-a517-f8f30fbf1018 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085862 Sep 07 08:23:06.116600 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 972/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:06 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:07.139120 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:07.139760 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:07.146708 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:07.147192 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:07.147630 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:07.148405 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:07.148859 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:07.149284 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:07.211055 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:07.219442 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-5ef1deed-0cfa-4ca5-8147-4cd2be7e2888 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.084229 Sep 07 08:23:07.220011 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 994/1966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:07 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:08.242957 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:08.243572 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:08.250087 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:08.250571 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:08.251008 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:08.252027 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:08.252522 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:08.253246 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:08.316299 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:08.324405 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2b3d5407-c84e-4fd0-acc8-c96d03f66d92 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085364 Sep 07 08:23:08.324958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 973/1967] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:08 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 08:23:09.348238 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:09.348849 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:09.355409 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:09.355888 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:09.356352 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:09.357035 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:09.357488 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:09.357905 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:09.360404 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_cell1:SELECT=84 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:23:09.421067 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:09.429418 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-4fd14340-fdcf-4819-a4aa-84911c77c9e4 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.085731 Sep 07 08:23:09.429989 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 995/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:09 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:10.453049 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:10.453662 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:10.460269 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:10.460754 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:10.461191 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:10.461884 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:10.462340 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:10.462769 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:10.526768 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:10.536005 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1c46bdfc-ab4d-478d-bd62-215c52379b23 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086859 Sep 07 08:23:10.536599 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 974/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:10 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:11.558933 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:11.559613 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:11.566359 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:11.566850 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:11.567294 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:11.567994 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:11.568493 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:11.568913 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:11.633634 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:11.641657 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-9b949fd5-f18e-4901-bd5a-aba51702261d tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.086833 Sep 07 08:23:11.642215 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 996/1970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:11 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:12.665250 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:12.665857 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:12.672488 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:12.672958 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:12.673385 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:12.674061 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:12.675140 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:12.675560 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:12.735798 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:12.744968 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c51311cf-5b6b-4f45-a802-3c075ea14e02 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083580 Sep 07 08:23:12.745534 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 975/1971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:12 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:13.766742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:13.767354 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:13.774567 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:13.775049 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:13.775485 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:13.776208 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:13.776667 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:13.777088 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:13.838687 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:13.846884 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-05616c34-b764-427e-9f36-85a9532a53e2 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.083974 Sep 07 08:23:13.847450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 997/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:13 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:14.869243 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:14.869850 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:14.872141 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=28 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:23:14.877328 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:14.878296 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:14.879002 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:14.879692 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:14.880167 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:14.880589 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:14.945145 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:14.953220 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-002f7013-4a3c-4e75-a8ce-ccead564d473 tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.087842 Sep 07 08:23:14.954232 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 976/1973] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:14 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:23:15.976841 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.api.openstack.wsgi [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Calling method '>' {{(pid=120494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:23:15.977452 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.compute.api [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] [instance: fe19217f-e207-4d14-ab09-b60b3f86d950] Fetching instance by UUID {{(pid=120494) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 08:23:15.979742 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG dbcounter [-] [120494] Writing DB stats nova_api:SELECT=28 {{(pid=120494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:23:15.986350 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:15.987200 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:15.987647 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:15.988876 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Acquiring lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 08:23:15.989686 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 08:23:15.990150 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG oslo_concurrency.lockutils [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Lock "1b28c4aa-1c51-47f0-9ca4-409ec11b013c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 08:23:16.053133 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: DEBUG nova.policy [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef73a49de304706a59335eff37debf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f785182c7d64af5ab5d37a4b95275b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120494) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 08:23:16.061883 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: INFO nova.api.openstack.requestlog [None req-f666e6b9-0807-43f0-bfa2-2435fa35419c tempest-VolumesSnapshotTestJSON-1585193218 tempest-VolumesSnapshotTestJSON-1585193218-project] 10.222.0.26 "GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950" status: 200 len: 1350 microversion: 2.1 time: 0.089202 Sep 07 08:23:16.062450 dv-cinder-836027-10-iscsi devstack@n-api.service[120494]: [pid: 120494|app: 0|req: 998/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 7 08:23:15 2022] GET /compute/v2.1/servers/fe19217f-e207-4d14-ab09-b60b3f86d950 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 08:24:25.898964 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:24:25.899758 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=41 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 08:24:25.900556 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:24:25.900748 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1041568426 (ip 10.222.0.26) !!! Sep 07 08:24:25.903401 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 08:24:25.903401 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: Wed Sep 7 08:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1041568426 (ip 10.222.0.26) !!! Sep 07 08:24:25.917941 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f0c60363-39c1-4429-a880-63d37a0ca453 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] Calling method '.version_select at 0x7f831e9abd30>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 08:24:25.947421 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f0c60363-39c1-4429-a880-63d37a0ca453 tempest-TestVolumeBootPattern-408637989 tempest-TestVolumeBootPattern-408637989-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1041568426" status: 202 len: 0 microversion: 2.1 time: 0.050001 Sep 07 08:24:25.954614 dv-cinder-836027-10-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 977/1975] 10.222.0.26 () {58 vars in 1263 bytes} [Wed Sep 7 08:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1041568426 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)